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JOB ATTITUDES IN MANAGEMENT: 


J. PERCEIVED DEFICIENCIES IN NEED FULFILLMENT 


AS A 


FUNCTION OF JOB LEVEL’? 


LYMAN W. PORTER 


University of California, Berkeley 


This questionnaire study investigated perceived need fulfilimeni deficiencies in 
nearly 2000 managerial positions. Respondents represented all levels of manage- 
ment and a wide variety of companies. 5 need categories, chosen to represent 
a hierarchy of prepotency of needs, were studied. Results showed: (a) Vertical 
level of position within management had a strong relation to the degree of 
perceived satisfaction of the 3 highest-order needs—Self-actualization, Auton- 
omy, and Esteem; for these needs, satisfactions increased at each higher level 


of management. (b) For the 2 


lower-order types of needs, Security and 


Social, there were no systematic changes in satisfaction in relation to manage- 
ment level. (c) Among the 5 need categories, Self-actualization and Autonomy 


were consistently the 


management. 


regarded as 


Until recently, industrial psychologists 


studying job attitudes have tended to focus 


primarily on the nonmanagement, line worker. 
However, in the last few years several studies 
have been published which reflect an increas- 
ing interest in the job attitudes of manage- 
ment personnel (Harrison, 1960; Herzberg, 
Mausner, & Snyderman, 1959; Porter, 1961a, 
1961b; Rosen, 196la, 1961b; Rosen & 
Weaver, 1960; Triandis, 1959a, 1959b). 
Most of these recent studies, especially those 
of Rosen and Porter, have paid particular 
attention to the hierarchical structure of man- 
agement as a factor influencing job percep- 
tions. This variable, level of position with the 
hierarchy, is the basic independent variable 
studied in the present investigation. 

1This study was carried out as part of the re- 
search program of the Institute of Industrial Rela- 
tions, University of California, Berkeley. It was 
started while the author was a Ford Foundation 
Faculty Research Fellow. The Institute of Social 
Sciences at the University of California and the 
American Management Association contributed to 
the support of the research assistance. 

The author is indebted to Mildred Henry, Larry 
Stewart, and Robert Andrews for assistance in 
tabulation of the data. 


least 


fulfilled needs at all levels of 


The present study is designed to extend 
and enlarge upon the results of a previous 
study of perceived need satisfactions in man- 
agement jobs (Porter, 1961b). This earlier 
study utilized a modified Maslow-type cate- 
gorization of needs in investigating perceived 
deficiencies in fulfillment and perceived im- 
portance of various needs. The five areas oi 
needs studied, from lowest-order (most basic 
or prepotent) to highest-order (least basic or 
prepotent), were security, social, esteem, au- 
tonomy, and self-actualization needs. Ques- 
tionnaire respondents in this previous study 
were drawn from the lowest levels of manage- 
ment in three different organizations, and the 
data analysis was focused on differences in 
perceptions between individuals in first-level 
supervisory jobs versus those in lower-middle 
management jobs. The results of this initial 
study showed that level of position (at least 
at these lower levels of management) was re- 
lated to the amount of perceived deficiencies 
in need fulfillment, with the lowest level indi- 
cating larger deficiencies than the level above 
them. Among the five need categories, the 
highest-order areas of self-actualization and 
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autonomy were regarded as the least satisfied 
needs. 

The purpose of the present study is to in- 
vestigate differences in perceived deficiencies 
in need fulfillment at all levels of manage- 
ment from the first level of supervision to the 
presidential level. The present study extends 
the previous study by providing data from a 
sample that has a considerably larger NV, that 
is drawn from numerous types and sizes of 
companies located throughout the country, 
and, especially, that represents management 
from the bottom to the very top. 


METHOD 
Ouestionnaire 


As in the previous study (Porter, 1961b), 
for this study were obtained by 


tionnaire. 


the data 
means Ol a 


rhis questionnaire contained three sections, 


ques- 


two of which will not be reported further here. The 
relevant part of the questionnaire contained 13 
items classifiable into a Maslow-type need hierarchy 
system. The printed instructions for this part of 
the questionnaire stated: 
On the following pages will be listed several 
characteristics qualities connected with your 
management position. For each such characteristic, 
you will be asked to give three ratings: 
a. How much of the characteristic is there 
connected with your management position? 
b. How much of the characteristic do you think 
should be 
position ? 
c. How important is this position characteristic 


or 


now 


connected with your management 


; nao? 
O VOuKs 


For each of the 13 items, the respondents were 
instructed to answer the above three questions by 
circling a number on a rating scale extending irom 
1 to 7, where “low numbers represent low or mini- 
mum amounts, and high numbers represent high or 
maximum amounts.” A typical item appeared as 
follows on the questionnaire: 


The opportunity for indepen 
iction in my management position 


a) How much is there now? 
(min) 12 3 4 5 6 
How much should there be? 
mm tt 23 4s G6 
(c) How important is this to me? 
fr 8 2 8. 4.5 6 7 


max) 
(b) 


(max) 


(max) 


As will be explained in the Results section, only 
the answers to Parts a and b of each item were used 
to assess the degree of need deficiency. Answers to 
Part c on “importance” will be reported in a future 
paper. 
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Categories of Needs and Specific Items 


Listed below are the categories of needs studied 
in this investigation, along with the specific items 
used to elicit information on each category. The 
items were randomly presented in the questionnaire, 
but are here listed systematically according to their 
respective need categories. The rationale behind the 
categorization system been presented in the 
previous article (Porter, 1961b) and will not be 
repeated here. It can be pointed out, though, that 
the system is designed to be in general agreement 
with Maslow’s hierarchical classification scheme 
based on the supposed “prepotency” (or priority) of 
various types of needs (Maslow, 1954). The cate- 
gories, arranged from lowest-order (most pre- 
potent) to highest-order (least prepotent), and their 
specific items follow: 


has 


I. Security needs 

1. The feeling of security in my 

position 
II. Social needs 

1. The opportunity, in my management position, 
to give help to other people 

2. The opportunity to de 
in my management position 

III. Esteem needs 

1. The feeling of self-esteem a person gets from 
being in my management position 

2. The prestige of my management position in- 
side the company (that is, the regard received from 
others in the company) 

3. The prestige of my management 
outside the company (that is, the regard 
others mot in the company) 

IV. Autonomy needs 

1. The authority connected 
ment position 

2. The opportunity inde pendent 
and action in my management position: 

3. The opportunity, in my management posi- 
tion, for participation in the setting of goals 

4. The opportunity, in my management position, 
for participation in the determination of methods 
and procedures 

V. Self-actualization needs 

1. The opportunity for personal growth and de- 
velopment in my management position 
2. The elf-fulfillment a person gets 

being in my position (that is, 
the feeling of being able to use one’s own unique 
capabilities, realizing one’s potentialities) 

3. The feeling of worthwhile accomplishment in 
my management position 


management 


friendship 


} } 
velop LOSE 


position 
received 
from 
with 


my manage 


for thought 


feeling of 


from management 


Procedure and Sample 


The 


mately 


questionnaire was distributed to approxi- 
6,000 managers and executives throughout 
the country. It was sent to a random sample of 
3,000 members (approximately 10%) of the Ameri- 
can Management Association and to another random 
sample of some 3,000 managers whose names were 
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FABLE 1 


DISTRIBUTION OF N or Toral 


SAMPLE BY 


FivE MANAGEMENT LEVELS 


AND Four AGI 


GRO! 


AND CHARACTERISTICS OF SAMPLE BY MANAGEMENT LEVEI 


Managen 
level 


President 
Vice Presice 
Upper-Mid 
Lower-Middle 


Lower 


on mailing lists available to the Association.* The 
distribution of the questionnaire was accomplished 
by mail, with enclosures including a letter 
from the Association and a prestamped return en- 
velope, as well as the 12-page questionnaire. Re- 
1,958 managers ra 


approximatel 


covering 


sponses were received 
rate ol 


number of usable 


irom 
response 
questionnaires being 

From personal data questions asked on the last 
page of the questionnaire, it was possible 
respondents on a 
The two 
level of 
control 


to classily 


number of independent variables. 
relevant variables for 
position within mana 
variable) age of the 
of position, a five-category 
categories were 


this udy were 
and (as a 

For level 
system was set up. These 


responcent 


from top to bottom 
President: presidents and chairmen of board 
Vice President: vice presidents (or 
in large companies) 
Upper- Middle 


managers, plant managers, and 


their equivalents 


level of division 


approximately 


major de partment 
managers 
pproximately the | lofd rt 
approximately the level of depar 
xd subdepartment 


Lower: 


managers 
first-level or second-level supervisors 


respondents to the above cate- 
rories of level of position was made on the follow- 
ing basis: Anyone having the title of president or 
chairman of a board of directors was automatically 
put in the President category, and this category was 
(Presi- 
this 


Vice 


limited to these two chief executive positions 
dents accounted for 90% of the 
category.) Individuals were 
President category on the basis of having a vice 
president title (including such titles as assistant 
vice president) or its equivalent in very large com- 
panies. (Examples of equivalent types of positions 
would be certain staff positions, such as controller. 
Thus, although the title was not that of a vice 
president, the respondent would be put in that 
category if he indicated that he reported to the chief 


individuals in 


assigned to the 


2 The assistance of the 
Association, and particularly 
in obtaining the sample of 
acknowledged. 


American Management 
Robert F. Steadman, 
respondents is gratefully 


Total 
N for 


level 


114 
611 
659 
43] 


101 


execulive of the organization.) Respondents who 
did not qualify for the President or Vice 
categories were assigned to one of the 
levels on the basis of their answers ¢ 
(a) How levels of 


your organization r 


President 
other three 
o two questions: 
supervision there in 
b) How many levels of 
vision are there above your position? Those respond 
ents who indicated by their 
that they were in the 
supervision were automatically 


many 
supel 
answers to these two 
lowest level of 
placed in t Lower 


questions 


bottom) category. The remaining respondents wer 
placed in the Upper-Middle, Lower-Middle, or Lower 
category, depending upon the ratio of levels of 
supervision above them to the total levels 

vision in their organizations. A s} 
was worked out for 
of this 

classified 


ystem of “fractions” 
The key featur 
that resp ts wv 


Same Cat 


this assignment 
fraction system was 
together in the 
their relative distance up the manager 
regardless of size of company 

For this study, level 
independent variable. However variabl 
extent correlated with the age of the 
respondent, it was felt 
ents by age 
way, 
levels within different age groups, the age variab] 
could be more or less held constant and the level 
variable independently assessed. Th 


is to some 
necessar} lassify 


as well as by lev 


respond 
In this 


among manage 


position 


by looking at differen 


for classi 
fication by age were obtained fr one of the per 
sonal data questions that asked the 
indicate his age in on 


respondent to 
of eight age In the 
data analysis, the five management levels were cross 
tabulated against groups: 20-34, 
45-54, and 55+. A further important advantage of 
tabulating responses by age as 
ment level was that by 
five management 


categories 


four age 35-44 


well as by manage- 
having four age groups of 
levels, it was possible to replicate 
management level effects in four independent samples 

Table 1 presents the characteristics of the sample 
by the five management levels. This table 
that, as would be expected, the higher levels have 
somewhat older personnel. With regard to amount 
of formal education, however, the five levels are ap- 
proximately equivalent in terms of the percentage 
of respondents holding college degrees. This means 
that the level in this 


shows 


lowest sample is probably 
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com} osed mostly of offic Ly px supervisory and staff 
personnel rather than foremen of blue collar workers 
because of its relatively high percentage of college 
educated respondents. Therefore, any conclusions 
involving the lowest level of this sample would not 
necessarily apply to first-line foremen who do not 
high a level of formal schooling 
the fact that all five levels in the sample for this 
study have almost identical amounts oi 


have as However, 


1or mal 


ducation makes it possible to assess trends for el- 


fects of level independently of those tor an 
education. 

fable 1 also presents the number of respondents 
in each management level within each age group. 
This table can be referred to in determining the Ns 
for the various cells in succeeding tables. 

One other relevant distribution of the sample (not 
shown in Table 1) is that for type of company. 
About 66% of the sample came from manufacturing 
companies, 7% from transportation and public util- 
ities, 7% from finance and insurance, 5% from 
wholesale and retail trade, and the remaining 15% 
was from among other companies. It 
should be stressed that due to the method of dis- 
tribution of the questionnaire, a nationwide sample 
was obtained; furthermore, except by chance, any 
particular company would not be represented more 
than a few times in the total sample. 


types ol 


RESULTS 

The degree of perceived deficiency in ful- 
fillment for each respondent on each question- 
naire item was obtained by subtracting the 
answer to Part a of an item (“How much of 
the characteristic is now connected with your 
position?’’) from Part b of the item (“How 
much of the characteristic do you think 
should be connected with your position?’’). 
An a priori assumption was made that the 
larger the difference—a subtracted from b— 
the larger the degree of dissatisfaction or the 
smaller the degree of satisfaction. This 
method of measuring perceived need satisfac- 
tion thus is an indirect measure derived from 
two direct answers by the respondent for 
each item. This method has two presumed 
advantages: (a) The subject is not asked 
directly concerning his satisfaction. There- 
fore, any tendency for a simple “response 
set” to determine his expression of satisfac- 
tion is probably reduced somewhat. It is more 
difficult, although by no means impossible, 
for the respondent to manipulate his satis- 
faction measure to conform to what he thinks 
he “ought” to put down versus what he 
actually feels to be the real situation. (5) 
Secondly, this method of measuring need 
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fulfillment is a more conservative measure 
than would be a single question concerning 
simple obtained satisfaction. It takes into 
account the fact that higher level positions 
should be expected to provide more rewards 
because it utilizes the difference between ob- 
tained and expected satisfaction. In effect, 
this method asks the respondent, “how satis- 
fied are you in terms of what you expected 
from this particular management position?” 
Thus, it is designed to be a realistic and 
meaningful measure in comparing different 
management groups. 

Table 2 presents the mean need fulfillment 
deficiencies for each of the 13 items in the 
questionnaire and for each subgroup of re- 
spondents. The values for each entry in Table 
2 were obtained by subtracting each respond- 
ent’s answer to Part a of each item from his 
answer to Part b of each item, and then 
calculating the mean of these values for each 
subgroup of respondents. No entries are given 
where the N for a cell is less than 20 because 
of the lack of stability in values based on 
such small numbers of respondents. 

Examination of Table 2 shows several gen- 
eral trends that will be brought out more 
clearly in succeeding tables. First, Table 2 
that need fulfillment deficiencies for 
most items definitely tended to increase at 
each successive lower level of the manage- 
ment hierarchy. This occurred within all four 
age groups. The second major trend observ- 
able in this table is that the largest deficien- 
cies were found in the items in the two high- 
est-order need categories, Autonomy and 
Self-Actualization. 

Table 3 brings into sharper focus the first 
trend apparent in Table 2, the trend for 
larger need fulfillment deficiencies to be asso- 
ciated with the lower levels.of management. 
Table 3 presents data on the number of 
changes in size of mean deficiencies from the 
higher to the lower levels of management. 
The entries for this table were obtained in 
the following manner: Changes of mean de- 
ficiencies greater than .05 scale units from 
one management level to the next in Table 2 
were counted as increases (+s) or decreases 
(--s) in deficiencies, depending on the direc- 
tion of change. Increases or decreases of 
OS or less scale units were counted as “no 


shows 
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rABLE 2 


MEAN NEED FULFILLMENT DEFICIENCIES FOR Each NEED CATEGORY AND I 
FrvE MANAGEMENT LEVELS by Four AGE Groups 


Management level 
Vice Upper Lower 


B 


Need category “ny Age group President Middle Middle 


Security 


Autonomy 


0.99 


{) &0) 
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lable 2 


Need category Item Age group 


1V-4 


(The 
unit as a 
“changes” and no arbitrary. 
The use of the .05 separation allowed for 
trends to show in the 
time 


changes” (Os 


decision to use .05 


scale dividing line between 


changes was 
data while at the same 
opportunity for 
chance fluctuations in sizes of 
fect the trends.) In Table 3 
each type of changes 
or no changes—in 


reducing the some 
means to af 
the number of 
increases, decreases, 
size of mean deficiencies 
from higher to lower management levels were 


recorded in the columns for each age group. 
Thus, for example, for Esteem Item ITI-1 
(‘The feeling of 


self-esteem a person gets 
from being in my management position’), 
Table 3 shows that in the 20-34 age group 
the mean deficiency increased three times in 
going from the top to the bottom management 
levels; in the 35-44 age there were 
three increases and one no change; and in the 
45-54 age group there were two increases and 
one no change; and in the 
there were one increase 
Combining the 
this 


nine instances of increase, 


group 


55+ age group 
ind two no change: 
tabulations for all fou 
item that there 


four of no change, 


ave 


groups for shows vere 


President 


PORTE! 


‘ontinued 
( inu 


Management level 


Vice Upper L 
President Middle Mid 


and no instances of decrease. Such a result 


by a simple sign test, significant at the 
level of confidence. 

The major results of the study are 
the last set of 
Table 3. The three columns for the total san 
ple show the total number of increases, de- 
creases, 


pre- 
pre 


sented in three columns in 


and no changes for each of the 13 
items. These columns also summarize the re 
sults for each of the five need categories by 
totaling the item results within each category. 
The f values for each item and category are 
listed in the footnotes of Table 3 

Table 3 shows conclusively that need ful 
fillment deficiencies progressively 
from the top to the bottom of the manage- 
ment hierarchy for three of the five need cate- 
gories—FEsteem, Autonomy, and Self-Actuali- 
zation. Eight of the 10 specific items in these 
three categorie: 


increased 


showed significant trends of 
increase in deficiencies at or exceeding the .05 
level of confidence (by a 


showed a trend significant 


ign test), one item 
it the .10 level of 
one of the 10 
a trend approaching sta 
tistical significance. On the other hand, for 


confidence, and only items 


failed to produce 
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the other two categories—Security and Social 
needs—there were no significant trends within 
items or categories. Thus in the two lowest- 
order need areas, security and social satisfac- 
tions, lower-level managers perceived them- 
selves to be about as satisfied as higher-level 
managers. However, for the three highest- 
order need areas—Esteem, Autonomy, and 
Self-Actualization—lower-level managers per- 
ceived their positions 
cantly less satisfaction compared with higher- 
level managers. It is especially interesting to 
note that these overall findings were 
ported with regularity in each of the four 
age groups, showing that these trends are not 
merely a function of higher-level managers 
being older, on the average, than lower-level 
managers. Age differences among managerial 
levels clearly do not explain the differences 


as providing signifi- 


sup- 
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in perceived need fulfillment deficiencies that 
occurred among the levels. 

In Table 4, the rank orders of the five need 
categories are presented. These rank orders 
are in terms of the size of the mean need ful- 
fillment deficiencies for each category of 
items for each subgroup of respondents. The 
category values on which these rankings are 
based were calculated on the the 
mean of the item within each 
category. For example, at the Vice President 
level and within the 35-44 age group, the 
Self-Actualization category had the largest 
mean deficiency, followed by the Autonomy 
Security, Esteem, and Social categories. 

The outstanding feature of Table 4 is that 
the Self-Actualization and Autonomy need 
areas consistently ranked first and second 
respectively, in terms of size of mean deficien- 


basis of 
deficiencies 


rABLE 3 


MEAN 


Category total 


Esteem 


Category total 


Aut mommy 


Self-Actualization 


Category total 
Total for all items 


® Anproaches 
*» = 0S 


+t 2 01 


DEFICIFE) 
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fABLE 4 


RANKS OF MEAN DEFICIENCIES FOR FIVE NEED CATEGORIES WITHIN SUBGROUPS 0! 


RESPONDENTS: FIvE MANAGEMENT LEVELs by Four 


Management 


level 


President 


cies in nearly all subgroups of respondents. 
{mong the other three need categories, Es- 
teem more ranked third in size of 
deficiencies, while the Social and Security 
need areas were about equal in being the 
areas with the smallest deficiencies. Secondly, 
Table 4 shows that the different managerial 
levels produced similar rankings of the five 
need areas in terms of deficiencies, although 
there were a few exceptions. One exception 
was the President level, where deficiencies in 
Social needs had relatively higher ranks and 
those for ranks than was 
the case with the other management levels 
Another exception was the tendency for de 
ficiencies in Esteem needs to receive some- 
what higher ranks at lower compared with 
upper levels of management. The third find- 
ing apparent in Table 4 is that deficiencies in 
Security needs tended 


often 


Autonomy lower 


to rank higher for 


AGE Groups 


Need category 


Self 
Actual 
ization 


Auton 


older individuals than for younger individuals 
(except at the chief executive level), whereas 
deficiencies in Social needs tended to receive 
somewhat higher ranks in younger compared 
with older manager groups at most levels. 
DIscUSSION 

Before considering the implications of the 
results of this study, the findings can first 
be compared with those from two previous 
relevant studies that were carried out on 
much smaller and less representative samples. 
In general, the results of the present study 
tend to confirm the earlier study carried out 
with the same set of need satisfaction ques- 
tions (Porter, 1961b). The earlier study, 
based on small samples from three companies, 
found consistent decreases in need fulfillment 
deficiencies between bottom management and 
the Jevel immediately above it (equivalent to 
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approximately the Lower-Middle level in this 
study). The current study shows generally 
the same finding at the two lowest levels, but 
also completes the picture by showing that 
this trend continues up to the very top man- 
agement levels. The two studies are also 
similar in showing that the two highest-order 
need areas, Autonomy and Self-Actualization, 
produce the largest deficiencies. In certain 
more specific aspects, the two studies show 
some other similarities and also some differ- 
ences in findings. An example of one of the 
differences is that the previous investigation 
indicated a trend of decreasing deficiency 
with increasing management level in the Se- 
curity need area, while the present study 
failed to find any meaningful trend in the 
Security area. Security needs seemed about as 
well satisfied at bottom as 
ment. Another difference is 
study showed no appreciable 
Actualization deficiencies 
management levels whereas in the 
present, larger investigation, there was a 
trend for deficiencies in this area to decrease 
with increasing levels of the hierarchy (al- 
though the deficiencies were still large in an 


at top manage- 
that the former 
changes in Self- 
between the two 


studied, 


absolute sense even at the top levels). Specific 
similarities between the 


two studies involved 
the Social need area which produced no 
trend in either study, and the Esteem and 
Autonomy areas. which 

trends in both studies. In 
parisons between the results for the previous 
study and present study can be made—at the 
Lower and Lower-Middle levels of manage- 
ment—the studies tend to be in 
agreement. In those specific 
the findings differ, the later study is probably 
more accurate because of its vastly increased 
size of sample, its considerable spread in 


produced definite 


sum, where com- 


general 
instances where 


types and sizes of companies represented, and 
because differences in amount of formal edu- 
cation between the 
controlled. 

The results of this study can also be com 
pared with those of a previous investigation 
by Rosen (1961a). The Rosen study reported 
on satisfactions with conditions of work given 
by managers from three levels (plus a group 
of staff managers) in a single industrial plant. 


two lower levels are 


Greater satisfaction with work conditions was 


found at higher management levels (the 
highest probably corresponding to the Upper- 
Middle level of this study), but the three 
levels produced similar rankings of the con- 
ditions in terms of degree of satisfaction. 
These results from a single specific company, 
although based on an entirely different set 
of satisfaction questions, are in agreement 
with the results of the current study. 

The major implications of the findings of 
the present study of nearly 2,000 managers 
would appear to be two: 

1. The vertical 
positions is an important factor in deter- 
mining the extent to which managers feel 
that they can satisfy particular psychological 
needs, especially the three higher-order needs 
of a Maslow-type system of need hierarchies 
It appears that there does exist a differential 
opportunity within management to satisfy 
Esteem, Autonomy, and Self-Actualization 
needs. Thus, individuals in the 


making positions of organizations may find it 


location of management 


top policy 


necessary to be as concerned with the satis- 
factions of their lower-level managers as they 
are with the satisfactions of their blue collar 
workers who usually have a union or other 
collective bargaining agency to represent their 
interests. Although this study does not neces- 
sarily show lower- and middle-level managers 
to be highly dissatisfied, it does definitely 
show them to be more dissatisfied than man- 
agers at top-level positions. In this connection, 
it should also be recalled that the 
satisfaction 


measure of 
(or dissatisfaction) used in this 
study took into account the fact that higher 
levels of management should be expected to 
provide greater rewards. The increasing dis- 
satisfaction at lower levels of management 
represents the increasing difference between 
what is expected and what is obtained. To 
put it another way, lower-level managers’ ex- 
pectations in most of the specific need satis- 
faction areas are much more divergent from 
their perception of reality 
top managers. For this situation to be 
changed, it would that either lower- 
level managers would have to change their 
expectations, or upper-level managers would 
have to change the chances for satisfaction in 


lower management, especially in the highest 


than is the case for 


seem 


order need areas, 
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2. The Seli-Actualization, Autonomy, and 
Esteem areas seem to be the most critical 
areas of need fulfillment deficiencies at all 
levels of management, with perhaps the pos- 
sible exception of the very top, chief execu- 
tive level. These three areas have always been 
mentioned as ones that are relatively unsatis- 
fied at the nonmanagement worker level, but 
the corollary assumption has also been that 
these are probably well satisfied throughout 
management. The results of this study cast 
some doubt on this assumption. Certainly 
they show that these three need areas are not 
nearly so well satisfied within management as 
the social and security need areas. Whether, 
in an absolute as well as a relative sense, 
they show a high level of dissatisfaction in 
management is a somewhat harder question 
to answer. Should, for example, mean dif- 
ferences between expectation and perceived 
1.00 scale units in the 
Upper-Middle manager level for the Self- 
Actualization items be considered large, 
medium, or small amounts of dissatisfaction? 
It is difficult to say. However, these particu- 
lar means correspond to approximately 50- 
60% of individuals indicating some degree of 
deficiency on each item. Thus, taking all of 
the evidence together, it would seem reason- 


reality of around 


able to conclude that fairly large numbers 


of managers even at high levels of organiza- 
tions are not satisfied with their opportunities 
to obtain the amount of Self-Actualization 
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they think should be available from their 
jobs. The same conclusion would hold true 
for the Esteem and Autonomy need areas, 
although to a slightly reduced extent. 
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ABLE 1 


DescripTIVE Data ror Eacu Group oF SUBJECTS 


First sample Validation sample 


ti SW NP CP SW NP 


22.96 20.90 


6.99 2.7 


121.28 
12.17) 


ilidation group consisted Table 1 presents a basic description of the Ss 
w classes (1 CP, 1 SW, and involved in the study. The requirements for entrance 
ly utilized all of the classes into the three courses are approximately the sam 
sion during the period of August hence, the several groups are generally quite similar 


161 lable 1 presents the means (and standard devia 
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tions in parentheses) of the ages, General Technical 
scores (GT),° and years of education, for the Ss in 
each course of instruction 


Procedure 


At the start of each course the CPI was admin 
istered to each class as a group. The tests were not 
scored or examined in any way until the 
graduated and final grades were available. The GT 
were obtained from the studenis’ military 
records. The criteria of (the stu- 
dents’ final grades) were the averages of their grades 
on several objective tests. These tests covered the 
lecture material presented in each course and were 
not in any way influenced by the present researchers. 


class had 


scores 


academic success 


RESULTS 


Table 2 presents the means and standard 
deviations for each CPI scale and the GT 
measure. In Table 2 (and for all future com- 
putations) the CP and SW classes have been 
combined while the NP class has been treated 
separately. This was done because the CP 
and SW courses are very similar in terms of 
course content, difficulty level, and course 
length. The NP course, on the other hand, 
is shorter in length and simpler in content. 
The CP and SW classes were also quite 
similar in terms of the final grades obtained 
in both courses. The CP class achieved an 
average grade of 82.14 (SD = 8.56) and the 
SW class an average grade of 83.18 (SD = 

5 The GT score is an average of the scores ob- 
tained on the Reading and Vocabulary (RV) and 
the Arithmetic Reasoning (AR) subtesis of the 
Army Classification Battery. Hedlund (1957) re- 
ports that a GT range of 90-109 approximates a 
Wechsler-Bellevue IQ range of 94-107 and a 
Wechsler Adult Intelligence Scale IQ range of 92-106 
The RV and AR subtests have also been found to 
correlate well with the Wechsler-Bellevue Form 1 
(Montague, Williams, Lubin, & Gieseking, 1957) 


INV! N TORY 


7.48). The NP class’ grades were somewhat 
lower, 80.32 (SD = 9.27). 

Table 2 also presents the obtained cor- 
relations (Pearson r) of CPI scales and GT 
with academic grades for the first sample. 

In order to refine the predictive accuracy 
of these measures, multiple prediction equa- 
tions were obtained using the 18 CPI 
and the GT measure as the independent 
variables with academic grades as the de- 
pendent variable. The results of the Wherry- 
Doolittle variable selection procedure indi- 
cated that the following combinations of 
variables had the maximal correlation with 
the criterion: NP class—GT + Ai and GT + 
Ai+ Sa; CP+SW classes—GT + Ai and 
GT + Ai+ Cm. The resultant multiple pre- 
diction equations were: 


wail 
sCaies 


3+ .319(GT)+.589(Ai 


.316(GT)+.658(Ai)+.497(Sa 


T 306(GT )+ 


.284(GT)+ 


.387 (Ai) 


.439(Ai)+.845(Cm 


where the formulas are in raw- form and 


score 


Xo = prt dicted criterion score. 


Hence, there were two equations per group 
of Ss, a two-variable and a three-variable, 
as they will be called. The next step in the 
study was concerned with a cross-validation 
of these equations on three new classes. Only 
two- and three-variable equations were con- 
sidered, since the addition of a fourth vari- 
able produced a negligible increase in the 
multiple R in the original sample. The pre- 


rABLE 3 
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PREDICTIO 
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dicted criterion scores were obtained for each 
S by solving the above equations. Correla- 
tions were then obtained between the pre- 
dicted and obtained criterion scores for 
each class. The results are presented in 
Table 3. 

DISCUSSION 


The correlations presented in Table 2 in- 
dicated that the CPI scales are measuring 
personality attributes which are related to 
academic success. In terms of the single meas- 
ures presented in Table 2, however, it was 
also obvious that the GT variable, a purely 
intellectual measure, is superior to any of the 
CPI scales in predicting academic achieve- 
ment. On the other hand, a combination of 
a measure of intellectual ability (GT) and 
a measure of personality functioning (the 
Ai scale of the CPI) is superior to any one 
of these variables taken alone. 

The Ai scale (Achievement via 
pendence) is described by Gough as having 
the following purpose: “To identify those 
factors of interest and motivation which 
facilitate achievement in any setting where 
autonomy and independence are positive be- 
haviors.” High scores are described (Gough, 
1960) as “Mature, forceful, strong, dominant, 
demanding, and foresighted; as being inde- 
pendent and self-reliant; and as having su- 
perior intellectual ability and judgment” 
ip. 23}. 

It appears, then, that this combination of 
variables will enable one to assess both the 
intellectual and motivational f that 


Inde- 


factors 
determine the degree of success that a student 
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will achieve in these particular areas of train- 
ing. The degree to which this measure is 
able to predict is quite surprising due to the 
fact that we are dealing with a fairly “select” 
group. The students in these classes have al- 
ready successfully completed basic military 
training (8 weeks) and an introduction to 
military medical activities (2 weeks for the 
CP and SW classes and § weeks for the NP 
class). There has already been much “weed- 
ing out” of those who have difficulty in ad- 
justing to the demands of military life. 
The data also indicate that the CPI is a 
much more useful instrument for differen- 
tiating poor and good students in the CP, 
SW, and NP classes than was the MMPI. 
Hewitt and Rosenberg (1961) found that 


successful graduates in these three courses 


had MMPI profiles that were more abnormal 
than those of students who failed the courses. 
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EFFECTS OF BRANCHING IN A COMPUTER CONTROLLED 
AUTOINSTRUCTIONAL DEVICE 
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System Development Corporation, Santa Monica, California 


2 groups of 15 high school Ss received instruction in logic from a computer con 
trolled autoinstructional device. In 1 group all Ss received a fixed sequence oi 
233 items. In the 2nd group each of the Ss received a different number and 


sequence of 


items, depending on the 


S’s performance during the lesson 


Branching decisions were based on errors and on the S’s evaluation of his own 
readiness to advance to new topics. Posttest scores were significantly higher 
(.05 level) for the branching group than for the fixed sequence group; training 


time differences were not significant. 


Experiments comparing fixed-sequence with 
variable sequence methods of autoinstruction 
have yielded equivocal results. One study, 
using manually controlled autoinstructional 
devices and a highly simplified form of 
branching based on student errors, showed a 
saving in training time for the variable 
sequence method but no difference in post- 
training criterion performance between this 
mode and the fixed sequence mode (Coulson 
& Silberman, 1960). In a second experiment 
(Silberman, Melaragno, Coulson, & Estavan, 
in press), a computer controlled autoinstruc- 
tional device provided a branching pattern 
with more alternative paths, but with student 
errors in training items again used as the 
sole branching criterion. This method was 
found not to differ significantly in either 
training time or criterion performance from 
a fixed sequence procedure. 

Another study, using manual presentation 
techniques, compared a fixed sequence mode 
with two variable sequence procedures in 
which the student was allowed to branch at 
his own option (Silberman, Melaragno, Coul- 
son, & Estavan, in press). One of the two 
variable sequence procedures was found supe- 
rior to the fixed sequence method on criterion 
performance, with no difference in training 
time. 

One factor apparently influencing the suc- 
cess of variable sequence autoinstruction is 
the nature of the branching criteria used to 
determine what item sequence should be given 
to each student. Such criteria should provide 
accurate evaluations during the lesson of the 
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student’s knowledge of topics which he is 
expected to learn. From these evaluations it 
should be possible to determine whether the 
student is ready to proceed to a new topic, or 
whether he requires additional instruction on 
the same topic. 

The present experiment was designed to 
explore the effectiveness of a procedure in 
which both the student’s errors on training 
items and his evaluation of his own learn- 
ing progress were used as branching criteria 
It was hypothesized that a combination of 
these two indices would provide effective 
evaluation of student progress, and _ that 
students taught with this procedure would 
score higher on a posttraining criterion test 
than another group receiving fixed sequence 
autoinstruction. It was further predicted that 
the variable sequence group would require 
less training time than the fixed sequence 
group. 

MerTHOD 

Two groups of 15 high school students were given 
automated instruction on logic by means of a 
flexible sequence, computer controlled autoinstruc- 
tional device. One group was designated the “fixed 
sequence group,” and the other was termed the 
“branching group.” Every member of the fixed 
sequence group received the identical sequence of 
233 instructional items. Each student in the branch- 
ing group was given a different number and se- 
quence of items, depending on his performance in 
responding to certain items during the lesson and 
on the student’s self-evaluation of his own progress 

A brief rest period was given every student toward 
the middle of the lesson. At the conclusion of the 
lesson each student received a written criterion test 
covering the materials in the lesson. This test was 
the same for all members of both groups. 
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Equipment 


The autoinstructional device used in this study 
has been described in an earlier report (Coulson & 
Silberman, 1961). It consisted of a general purpose 
digital computer (Bendix G-15) coupled to a 
random-access slide projector and an electric type- 
writer. The slide projector acted under computer 
control in selecting a sequence of slides, 
which contained one instructional item. 
used the typewriter to insert his 
choice questions contained in the 
receive knowledge of results c 
curacy of his answers. 

For the branching group the computer was 
programed to select item sequences on the basis of 
three student response criteria: (a) number of 
response errors cumulated over a set oi items relating 
to the same topic, (b) answers given by the sub- 
ject to individual questions where the erroneous 
alternative selected is indicative of a particular mis- 
understanding by the subject, (c) answers given by 
the subject to items asking whether he feels ready 
to advance to a new topic or is in need of further 
review on an earlier topic 

If a member of the 
many 


each of 
The subject 
answers to multiple- 
items, and 10 
icerning the ac- 


branching group made too 
1 particular topic or expressed a 
lack of confidence in his own progress, he was given 
extra remedial materials to strengthen his knowledge 
of that topic. Otherwise he 
to a new topic. 

For the fixed sequence 
presented each of the 232 


errors on 


was taken immediately 


merely 


device 


items in sequence 


group the 


Instructional Materials 


The 345 
this study 
ously by 
Estavan. 


logic used in 
used previ- 


instructional items on 


were revised from materials 

Silberman, Melaragno, Coulson, and 
Topics covered by these items included 
simple and compound statements, logical connectives, 
and six argument forms 

Materials were organized into “main stream” items 
using fairly large and diffi 
and remedial items 
smaller and more numerous steps 
written as statements, 
is diagnostic test questions. The diagnostic items, 
which formed the major basis for branching de- 
cisions, usually included several plausible distractors 
and were designed to be _ highly ing of 
student knowledge 

A number of self-evaluation 
in the revised materials items 
student to judge his own state of 
different topics. 

The 233 items given to all members of the fixed 
sequence group were selected by an independent 
consultant who was not associated with the experi- 
ment, nor with the original item preparation. The 
consultant was experienced in the development and 
experimental evaluation of self-instructional ma 
terials and familiar with the subject area being 
taught. He was given the full set of 345 logic items 


. : 
ult steps to cover topics, 
covering the same topics with 
Some items were 


while other items were written 


include d 
asked the 
knowledge on 


items was 


“hese 
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and a list of the topics covered by the criterion test 
He was asked to select from the items a sequence 
which he felt would provide effective instruction on 
the topics covered by the criterion test, and was 
also allowed to add any items which he believed 
appropriate. 


Subjects 


Paid volunteers from the junior and senior classes 
of two high schools in the Los Angeles area served 
as subjects in the experiment. Students were assigned 
to two groups of 15 subjects each. Each group 
contained students from both schools. The two 
groups were matched for average on the 
Henmon-Nelson Test of Mental Ability (Form A, 
Grades 9-12) administered before training. Henmon- 
Nelson means for the fixed sequence group and the 
branching group were 112.5 (SD = 12.9) and 113.8 
(SD = 15.9), respectively. Subjects were naive with 
respect to the subject matter (logic) used in the 
lesson. 


scores 


Criterion Test 

The posttraining criterion consisted of 51 multiple 
choice and 44 fill-in test items. Some of the ques 
tions were quite similar to the training materials 
while others required transfer to situations not 
encountered by the subject during training. The 
split-half reliability of the test was .97 (after Spear- 
man-Brown correction) 


RESULTS 


The mean number of instructional items 


seen by members of the branching group was 
213.5 with a standard deviation of 19.4. All 
members of the fixed sequence group received 
233 items. 


Required training times and posttraining 
criterion scores for the two groups are sum- 
marized in Table 1. 


TABLE 1 
ND POSTTRAINING CRITERION PER 


FORM FOR EXPERIMENTAL GROUP 
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Members of the branching group averaged 
8.9 points higher on the criterion test and 
required an average of 13.3 minutes less 
training time. The difference in criterion per- 
formance was significant at the .05 level 
(¢= 2.15, df = 28). A one-tailed test was 
used since the direction of the difference was 
predicted in advance. The difference in train- 
ing time did not reach significance. 

The correlation between aptitude score and 
posttraining criterion score was not significant 
for either group nor for the two groups 
combined. 

DISCUSSION 


Results of the experiment indicate an ad- 
vantage in favor of the branching procedure 
over the fixed sequence mode of instruction. 
Student training errors and responses to self- 
evaluation questions provided effective cri- 
teria for branching, presumably by serving 
as accurate indices of student learning 
progress. 

In an earlier study, using the same auto- 
instructional device and covering the same 
topics in logic, no difference was found be- 
tween a branching and a fixed sequence mode 
of instruction (Silberman, Melaragno, Coul- 
son, & Estavan, in press). A comparison of 
materials and procedures used in the two ex- 
periments reveals several dissimilarities which 
may account for differences in the results: 

1. Branching in the first experiment was 
based purely on training errors. The use of 
self-evaluation items as additional cues for 
branching in the present study probably in- 
creased the accuracy of evaluation of student 
progress. 

2. In the first study practically all items 
contained questions. Thus most items were 
used for both instruction and diagnosis. In 
the present study some items contained only 
statements, while other items were written 
specifically as diagnostic test questions. It is 
probable that the use of specially designed 
diagnostic items afforded better estimates of 
student readiness to advance to new topics 
in the lesson, and thus made the branching 
more appropriate to individual student needs. 

3. A remedial sequence in the earlier study 
contained more items with smaller steps than 
the main stream segment which it was in- 
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tended to supplement, but both main stream 
and remedial items used the same basic ap- 
proach in presenting the facts or concepts 
to be learned. The revised remedial items 
used in the present experiment approached 
topics differently than their corresponding 
main stream items. Thus, where the main 
stream items taught a particular topic de- 
ductively the remedial items might teach the 
same topic inductively. It is likely that the 
revised remedial materials were more effective 
in allowing students who had encountered 
obstacles on the main stream items to view 
the concepts being presented in a new 
perspective. 

4. In the first study each member of the 
fixed sequence group received the same se- 
quence of items as a “mate” in the branching 
group. The only difference between the two 
groups was that the sequence was deter- 
mined on the basis of errors made during 
the lesson by the branching group member, 
whereas this same sequence was given to 
the fixed sequence group member without 
regard to his performance on the materials. 
To further equate conditions for the two 
groups, knowledge-of-results messages for 
both groups contained only the number of 
the correct answer. One consequence of the 
attempt to hold conditions identical for the 
two groups in the first experiment was that 
certain types of branching and certain 
remedial materials could not be used in the 
branching condition. For example, no reme- 
dial items or knowledge-of-results messages 
could be given that referred specifically to 
the student’s answer to the previous item, 
since such a message would have been in- 
appropriate for the fixed sequence group mate 
who might have given a different answer. In 
the present experiment no attempt was made 
to equate exactly the materials seen by the 
two experimental groups. Members of the 
branching group were often given remedial 
items containing specific references to an- 
swers which they had given to preceding 
items. These remedial materials were designed 
to correct misunderstandings evidenced in 
the earlier responses. A remedial item, for 
example, might say, ‘““No, you gave the an- 
swer ‘VY’ when you should have an- 
swered ‘A.’ Remember, ‘ A’ represents ‘and’ 
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while ‘V’ represents ‘or.’”’ Thus the revised 
materials used in the present experiment 
were much more closely adapted to the needs 
of individual branching group members than 
was possible in the initial study. 

In summary it appears that the branching 
procedure used in the present experiment 
provided. more accurate diagnosis of student 
needs than was possible in the earlier study, 
and more effective remedial materials for 
filling these needs. Some support for this con- 
clusion is given by the fact that the correla- 
tion between student aptitude and criterion 
score was significant in the first study, but 
not in the second. This finding indicates that 
the remedial materials in the later experi- 
ment raised the performance of lower apti- 
tude students to that of the higher aptitude 
students, although the lower aptitude stu- 
dents required more training time to reach 
this level. Since there was no aptitude-cri- 
terion correlation in the second study for 
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either the branching group or the fixed se- 
quence group the reduction of student per- 
formance differences cannot be attributed 
entirely to the branching procedure. The fact 
that some of the items used for remedial 


purposes in the branching group were in- 
cluded in the materials selected for the fixed 
sequence group may account for the lack of 
correlation between aptitude and criterion 
score in the fixed sequence group. 
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DECEPTIVE PACKAGING: 
ARE THE DECEIVERS BEING DECEIVED? 


JAMES C. NAYLOR? 


Ohio State University 


To investigate the effects of deceptive packaging, 


sample packages of potato 


chips containing various amounts were distributed to consumers who purchased 
a regular pack of the same brand. The only difference between the sample and 
the purchased pack was in terms of quantity of chips with the sample packs 
having various deficits. Preference data were obtained via a follow-up inter- 


view. The analyses of the questionnaire data indicated that: 


(a) consumer 


did not perceive weight differences between packs, (b) all indices of consumer 
preference favored the free pack when the two were of equal weight, and 
(c) all indices showed a marked decrease in preference for the experimental 
pack as the contents of the experimental packs were decreased. 


The tremendous emphasis placed upon 
packaging as a wedge to success in the con- 
sumer market in recent years has resulted in 
certain packaging techniques which have 
been questioned on an ethical basis. The 
most outstanding of these is the practice 


known as “deceptive packaging.” Briefly de- 
fined, deceptive packaging involves a delib- 
erate attempt to mislead the consumer re- 
garding some aspect of the product (usually 
quantity) by using packages specifically de- 


signed to convey a false impression concern- 
ing this product attribute (e.g., making the 
package oversize). The extent to which this 
practice has become prevalent is difficult to 
state, although the fact that in recent months 
a Senate subcommittee was formed to inquire 
solely into this particular problem would at- 
test to its frequency of occurrence. 

From the point of view of consumer psy- 
chology, the problem is not primarily one 
of ethics, but rather of determining what ef- 
fect deceptive packaging has upon the con- 
sumer, per se. First, does he realize that he 
is being deceived? Second, what is the effect 
of the deception upon his perception of the 
product (a) if he feels he has been deceived, 
or (5) if he is not aware of any deception? 
The purpose of this study was to experi- 
mentally investigate a case of deliberate de- 
ceptive packing in an attempt to provide 
answers to some of these questions. 


1The author wishes to acknowledge the data 
collection efforts of G. Croft Henry, John Mitchell, 
and Don Shumaker, members of the research field 
team 


i METHOD 


The independent variable chosen for study was 
package quantity. Through the cooperation of a 
local potato chip manufacturer, it was possible to 
obtain 144 experimental twin packs which were filled 
to specified weight requirements. The normal con- 
tents of a regular twin pack in terms of weight 
was 9 ounces. The experimental twin packs were 
of three weights: 9 ounces (control packs), 8 
ounces, and 7 ounces. The experimental packs were 
all filled with chips from the same batch in order 
to assure equal treatment. All were packaged in 
regular twin pack containers in a normal manner 
The only difference between the experimental packs 
was in terms of quantity as determined by weight 
Two retail outlets were selected for distribution: a 
medium sized independent grocery located in a 
suburban area (Store A) and a large chain store 
market (Store B) in more metropolitan surroundings 

Procedure. Because of possible ill feeling which 
might have been generated toward the donor com- 
pany, it was not feasible to have the experimental 
packs actually purchased by the consumer. Thus, a 
procedure was adopted in which the experimental 
packs were given, free of charge, to any person 
willing to participate in the experiment. An observer 
was stationed with a supply of the 7-, 8-, and 9- 
ounce experimental packs within view of the normal 
store display. Any consumers who “purchased” (i.e., 
clearly selected from the display) a twin pack of 
the donor brand were approached by the observer 
and asked as to their willingness to cooperate in a 
university study of consumer preferences. They were 
told that they would receive a sample pack free of 
charge on the condition that they were to “compare 
the contents of the two packs (regular versus ex- 
perimental) in terms of personal preference.” This 
preference would be obtained by.a follow-up 10- 
minute interview in their own home within 3 days. 

If the customer was agreeable to this, he or she 
was then given one of the experimental packs as a 
gift (the three weights were distributed in random 
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rder) and a time and day ior the subsequent inter- 
view were agreed upon 

A reminder slip with the time and date for the 
interview was made out and stapled to the sample 
(free) pack. This slip also served to provide the 
basis for differentiation between the sample and the 
regular pack. 

Distribution of packs was done only between the 
hours of 4:00 p.m. and 9:00 p.m. on Thursdays, 
Fridays, and Saturdays. Twenty-four experimental 
packs were distributed every week—eight of each 
weight. This procedure was continued for a 6-week 
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period. To staleness of the experimental 
chips, they were obtained from the donor once 
every 2 weeks in lots of 48 (16 of each weight) 
Thus, over the 6-week period a total of 144 experi- 
mental packs was distributed—48 of each weight 
class. The first 3 weeks of distribution was in Storé 
A, the remainder in Store B 

Interview. The interview itself consisted of having 
the consumer fill out a short, nine-item questionnai: 
(see Table 1). The first five items were for the 
purpose of obtaining information desired by tl 
donor company, and Questions 6 through 9 wes 


prevent 


rABLE 1 


SAMPLE QUESTIONNAIRE USED IN THE INTERVIEW 


SAMPLE 


SEX 


Was this the first time you have purchased this brand? 


Do you usually purchase this brand? 
Do you expect to purchase this brand again? 


What did you like most about this brand? 


Yes 
Yes 


Yes 


What (if anything) did you like least about this brand? 


Please circle the point on the scale that expresses your reaction to each pack 


a. How well did you like the contents of the regular pack 


1 2 3 4 ] 8) / 


terrible 


poor average good 


8 9 


excellent 


b. How well did you like the contents of the sample pack ? 


1 x 4 5 6 
| | | | 
terrible poor average good 


8 9 


excellent 


7. If both were available for purchase the next time you went to the store, which would you buy 


sample pack 
regular pack 
either 
neither 
8. List three words that describe the two packs. 
a. Sample pack 
b. Regular pack 
9, Which pack had the most in it? 
regular pack 
sample pack 


same 
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designed to obtain preference information as a func- 
tion of perceived deception. Any requests for addi- 
tional insight into the experiment on the part of the 
consumer at the time of the interview were refused 
However, a promise to mail a short explanation at 
the conclusion of all interviews was made where 
desired. All requests were subsequently 
honored. 
Interviewers. 


such 
The distribution of packs and the 
subsequent interviewing of consumers were done by 
a three-man research team 
psychology graduate student 
psychology majors 


consisting of a senior 


ind two undergraduate 


RESULTS 


Sample Characteristics. Only six customers 
declined to participate in the survey when 
approached by the observer, making the total 
acceptances 144 out of 150. This represents 
a loss of only 4%. Out of the 144 customers 
who agreed to participate, however, 26 were 
lost during the interview phase—primarily 
due to absences as a function of summer 
vacation. Thus, the final data sample con- 
sisted of 118 consumers. Table 2 shows the 
age and sex characteristics for the 114 peo- 
ple who responded to these two interview 
questions. 

As indicated in the table, the sample was 
predominantly female. A chi square test was 
performed on the sample frequencies to de- 
termine if the relative proportion of males 
and females differed‘for the three experi- 
mental groups. The results clearly indicated 
that they did not (y* = .167, df=2, p> 
99). In addition, a simple analysis of vari- 
ance test was made to test for age differences. 
The mean ages for the three experimental 
groups were not significantly different (F 
04, 67 = 27113). 


In order to discuss the results of deceptive 
packaging, it was necessary to have some in- 


rABLE 2 


BREAKDOWN OF CONSUMER SAMPLI 


TERMS OF AGE AND SEX 


> PACKAGING 


rABLE 3 
FREQUENCY OF PEOPLE JUDGING EXPERIMENTAI 
REGULAR PACK AS HEAVIEST AS A 
EXPERIMENTAL PACK WEIGHT 
(N = 118) 


FUNCTION OF 


Pack judged heaviest 


Weight of 


experimental pack Experimental Regular 


9 ounces 
8 ounces 


7 ounces 


Note 


dication of the extent to which the weight 
shortages in the sample packs were perceived 
by the consumers. Table 3 shows the fre- 
quencies of the responses to the categories of 
Question 9 on the questionnaire. Regardless 
of experimental pack weight, the majority of 
the responders indicated the two packs as 
being equal in contents. A chi square test of 
significance showed no significant shift in 
proportions as the contents of the experi- 
mental pack was decreased (,* = 3.121, df = 
4, p< .50). 

It was possible to obtain two judgment 
scores for each person—his judgment for the 
regular pack and his judgment for the experi- 
mental pack—from Question 6. A difference 
score was then computed for each individual 
using the following formula: Experimental 
Pack Scale Value — Regular Pack Scale 
Value. 

This resulted in a indicating the 
degree to which the contents of the experi- 


score 





r of Sample Pack 


n Fav 


Boz 7 
f Sample Pack 
Fic. 1. Preference in favor of the contents of the 
experimental pack as a function of experimental pack 
weight. 
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rABLE 4 
ANALYSIS OF VARIANCE OF THE DIFFERENCES IN 
THURSTONE JUDGMENTS OF PREFERENCE BETWEEN 
REGULAR AND EXPERIMENTAL Packs AS A FUNC- 
TION OF EXPERIMENTAL PACK WEIGHT 
(N = 118) 


Source 


Weight 


Error 


*p < .05. 


mental pack were preferred over those of 
the regular pack. The mean of these scores 
was then computed for each group (see Fig- 
ure 1). When the two packs were of equal 
weight a marked preference was indicated for 
the experimental pack. When the experi- 
mental pack was 1 ounce less, however, the 
preference for it was only slight, and when 
there was a 2-ounce difference the regular 
pack was substantially preferred. An analysis 
of variance of these judgment differences (see 
Table 4) indicated that the decrease in pref- 
erence for the experimental pack as a func- 
tion of its weight was statistically significant 
at the .05 level (F = 4.58, df = 2/115). 

A second measure of the effect of weight 
on preference was obtained by analyzing the 


= = 


responses to Question 7. Table 5 shows the 


distribution of responses to the alternatives 
presented by this question. The response al- 
ternative “neither” only attracted a total of 
four responses and was therefore eliminated 
in the analysis. When the packs were of 


TABLE 5 
DISTRIBUTION OF PREDICTED NExT PurCHASE CHOICE 
AS A FUNCTION OF EXPERIMENTAL Pack WEIGHT 


Weight 
of sample 


9 ounces 
5 ounces 


7 ounces 


TABLE 6 


SCALE VALUES OF DeEscrRIPTIVE ADJECTIVES USED TO 
DESCRIBE SAMPLE AND REGULAR PACKS 


Mean 
scale 
value 


4.6 
45 
4.4 


4.3 
4.2 
4.1 
4.0 


Words or phrases 
Crispy, Delicious 
Very tasty, Crisper 
Very very 


Superb 


good, Very fresh, Excellent, 


Scrumptious, Very good, Fresh 

lastier, Crisp (as usual), Tasty 

Always good 

Good taste, More crisp, Crisp, Full of 
color, Flavorful, Better flavor, 


Flav yrrsome, Good 


Lighter color, Bigger 
s oily, Dryer 
t, Palatable, Salty 
nder, Saltier, Shorter, Same 
Not to 


M Ider, 


ily, Brown edges 
Small, Not as large 
Not as thin, Unsized, Greasy 
good, Less salty 
taste, Average, Rough 
r, Too thin 


me, Ordinary, Thicker 
ler, Cheesy taste, Too brown 
Not enough 
} 
Less flavorful, Heavy texture, 
very good, Not as crisp 
Oily, Burnt, Green, Scanty amount 
Hard, Not crisp, Unseasoned 
Flat 
A little greasy, Mealy 
Greasy, Undesirable 
Slightly stale, Greasy taste 


Bitter, Limp, Tasteless, Too greasy 
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equal weight, the majority of the consumers 
stated that, if given a choice, they would 
purchase the experimental chips. With a 1- 
ounce weight differential the plurality re- 
sponse changed to “would buy either,” and 
with a 2-ounce difference the plurality re- 
sponse was in favor of the regular pack. A 
chi square test indicated that this change in 
preference was significant at the .05 level 
(x? = 10.203, df = 4). 

A third analysis of package preference was 
obtained through the descriptive adjectives 
applied to each pack in Question 8. A total of 
109 different adjectives or adjective phrases 
were used by the consumers in describing the 
two packs. These phrases were given to 10 
judges (psychology graduate students) who 
rated each of them for favorability on a 
five-point Thurstone rating 
and their resulting mean scale values are 
shown in Table 6. The analysis of vari- 
ance reliability for the ratings was .96, and 
the difference between rater zero points was 
significant at the .01 level (F 23 
108/792). 

Each person was then assign 
scores on the basis of the adjectiy 
describe the regular and experiment 
using the favorability scale value for 


scale. The phrases 


j 


used to 


each 

adjective. The difference betwee 

means was then computed as follows 

jective scale value for experimental pack) 

(X adjective scale value for 
This resulted in an 

score for the experiment 


regular pac k ). 


adjective pre 
i] 


ren 


pack for 


each per- 





r 


Fic. 2. Mean difference in scale 
used to describe experimental and 


a function of experimental pack weight 


son. The mean of these adjective preference 
scores was then computed for each group 
(see Figure 2). The same pattern of pref- 
erence as a function of experimental pack 
weight was found with the adjective values 
as had been found previously with the Thur- 
stone judgments. As the weight of the ex- 
perimental pack contents was decreased, the 
preference for that pack also decreased. The 
analysis of variance on the means in Figure 
2 indicated that they were not significantly 
different from one another (F = .34, df= 
2/115) even though the differences were in 
the expected direction 


DISCUSSION 


Deception in packaging can occur in two 
general ways. First, a consumer may be de- 
ceived at time of purchase and subsequently 
discover this deception at the time of prod- 


uct consumption. Such a case may be con- 


idered a “purchase deception.” Second, a 
may 
chase and not discover the deception at all. 
The latter may be 


deception.” Since 


consumer be deceived at time of 


pur- 


considered a “consumption 
the data from Question 9 
indicated that even actual 

msuming of the chips people were not aware 
of any shortages, the results of the study may 
} 


following the 


+ ag 
ve considered as applying to 


1 consumption 
ise deception. 


deception and not to a pl rcl 


From an ethical point of view the con- 
eption is the 
the consumer 


since 
inything amiss, 
will supposedly continue to be satisfied with 
his purchase. With a purchase deception, 
however, he is overtly aware of having been 
taken able to 
modify his subsequent buying behavior to 


ivoid a repeat deception. The results of the 
1 


sumption de most severe 


unaware of 


advantage of and is thus 


several preference indices computed in this 
study, however, indicate that even in the case 
yf 


a consumption deception there is created 
a dissatisfaction with the product, even 
though the source of dissatisfaction cannot 
As the con- 
pack were de 
related decrease in prod 
pack 


sig- 


be identified by the consumer! 
tents of the experimental 
creased, there wa 
uct preference for the rimental 
This 


nificantly so for 


exp 
indices 


The 


occurred for all three 


two of them. non- 
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significance in the third case may have been 
a function of limited variance due to the 
use of a five-point Thurstone scale in scaling 
the adjectives. 

The fact that the experimental pack was 
markedly preferred with all indices when it 
was the same weight as the regular pack was 
probably a function of (a) the fact that it 
was free, and (6) an aura of “if its some- 
thing new, it must be better” surrounding the 
free pack. The end result was to produce a 
halo effect (see Figure 1) which accounted 
for the experimental pack preference. 


NAYLOR 


If indeed the answers to Question 7 were 
true predictors of future buying decisions, 
the fact that a consumption deception had 
occurred would result in a decrease in pur- 
chases for the pack having a weight short- 
age, and this decrease would be related to the 
degree of deception involved. While such 
extrapolation of buying behavior on the 
basis of questionnaire responses is sometimes 
dangerous, the implications should be ob- 
vious to those engaged or planning to engage 
in a program of package deception. 


(Received October 31, 1961) 
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CLASS ASSIGNMENT IN THE LATENT PROFILE MODEL 


W. A. GIBSON 


Personnel Research Office, Department of the Army, Washington, D. C. 


The latent profile model provides a way of establishing an empirically-based 
typology from quantitative measures, and this paper sketches a method for assign 
ing any person’s score profile to its most appropriate type 


Latent profile analysis has been described 
elsewhere (Gibson, 1959) as the generalization 
to quantitative data of latent structure analysis 

Lazarsfeld, 1959). The latent profile analysis 
of intercorrelations rj, among » continuous 
variables divides the total sample into a set of 
q subsamples or /atent classes, for each of which 
is given its size and its profile of standard score 
means on the » variables. These latent profiles 
ire then to be compared and interpreted as to 
the kinds of people they characterize. Thus 
latent profile analysis provides a way of 
evolving empirically-based typologies such as 
personality categorization, psychiatric syn- 
dromes, job interest constellations, or modes of 
political behavior. 

The latent structure 
models attribute all covariation 
among the 2 variables to variation between the 
latent classes, so that within-class variation is, 
by definition, statistically independent. This 

the local independence definition of a latent 
class. The rationale for this definition is that if 
a class is made homogeneous enough, with 
respect to whatever and however many under- 
lying dimensions or “factors” may be involved, 
then all within-class covariation attributable 
to those underlying dimensions will have been 
partialed out. 

Given the results of a latent profile analysis, 
how can subjects be assigned to their most 
appropriate latent class? For purpose 
consider the #-dimensional scatter diagram of 


and latent 
observable 


profile 


this 


standard scores, and, for concreteness, imagine 
n = 3. Imagine, further, that two latent classes 
uffice to account for the intercorrelations, or 
that g = 2. Now each latent profile defines a 
point in that three-space, and the members of 
the associated latent class are presumably, by 
virtue of local independence, clustered ran- 
domly around that point. Thus an equal- 
density contour of the class is an ellipsoid with 
its three axes parallel to those of the scatter 


diagram as a whole. The comparable contour 
of equal relative density for the other class is, 
assuming homoscedasticity of within-class 
variance, an ellipsoid of identical size and 
orientation, but with different position. 

The length of each semiaxis of such an 
ellipsoid is determined by the within-class 
variance of the associated variable. Since we 
are dealing in standard score units, the within- 
class variance of Variable j is the complement 
of (or one minus) the between-class variance, 
T ji, obtainable from the latent profile solution. 
Then the length of Semiaxis 7 of the ellipsoid 
that corresponds to one unit of within-class 
variance is the square root of the within-class 
variance of Variable j, or is simply V1 — r,;. 

The n-dimensional scatter diagram con- 
taining g families of concentric ellipsoids may 
be converted into a system of spheres by thx 
simple trick of dividing all standard scores on 
each Variable 7, including those in the latent 


profiles, by V1 — 7;;. This merely stretches the 
various axes so that spheres result, and it 
makes the unit of measurement in all directions 
be the square root of within-class variance. 


Now each person might possibly be assigned 
to that class to whose center he is closest. 
Squared distances, computed either as sums of 
squared differences between coordinates or by 
the cosine law in the “spherized” scatter 
diagram, would suffice for that purpose. With 
equal class sizes, such a procedure would 
amount to assigning each person to the latent 
class from which he is most likely to have come. 
size must enter the 
picture since, for example, a person who i 


However, varying class 


equidistant from the centers of two classes of 
unequal size is more likely to have come from 
the larger. 

With unequal class sizes, a maximum likeli- 
hood assignment procedure is a little moré 
elusive, though not so much as might first 
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Fic. 1. Latent class p for n = 2 


appear. Local independence and the spherized 
space make the relative frequency of Score 
Profile 7 in Latent Class p depend only upon 
the associated dist and the dimen 

of the space. Figure 1 illustrates 
why this is so for the case where » = 2. No 
matter what diré Point from the 
center of the class, , an isosceles right triangl 
can be constructed as shown with squared side 
equal to d,,?/2 by virtue of the Pythagorean 
theorem. Now bivariate normal 
surface with p= 0 centered upon Point p. 
Its height at Point 7 is, because p= 0, 
simply the product of associated marginal fre- 
These frequen ies 
become identical when the axes are placed 


nce, d 
? 


sionality, 7 


tion 1 is 


imagine a 


quencies. two marginal 
parallel to the legs of the isosceles right tri- 
angle, and they are then proportional to the 
ordinate of a unit normal curve at Point d,,/V2. 
This line of argument generalizes to m space, 
wherein the relative frequency of Profile i in 
Class p is proportional to the mth power of the 
unit normal ordinate at Point dj,p/Vn. Ex 
pressed in terms of the proportionality constant 
c and the equation of the unit normal curve, 
the marginal frequency in question becomes 


é 
r 


| 1 
v2 % 


and its wth power i 


c \e 
(= ni [2] 
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Multiplying the latter by the Class 


( c 
N 2m 


as the absolute number of people with Profile : 
who belong to Class p. Computation of this 


absolute frequency across all of the latent 
} 


Size fy, 


- 
gives 


classes provides the means for assigning all 
people with Profile 7 to the class to which the 
most such people belong. The amount of mis- 
classification will then be the sum of the fre- 
quencies for that profile in the remaining 
classes. 


The natural logarithm of Expression 3 is 


( \ 7.2 
nin >+ ln f ee ; . 
\ =) . 2 


term is constant and the 


in which the frst 


second depends only on class size. 


Dropping 


the first term and doubling the last two gives 


[5] 
lated to Ex- 
pression 3, hence just as good for assignment 

that 
for maximt likelihood assign- 


jual cle that 


> r) + ; ] 
monotonic: 


purposes. Expression 5 shows distance 
alone suffice 
i class 


ment with iss sizes, and 


size alone determines assignment for equal 
distances. 
Assignment to type is an important aspect 
of a typology that has already been established, 
but such assignment can also lend concreteness 
in the 


l 


having actual examples of the types helps to 


early stages of establishment, where 


suggest what kinds of people they are. 
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PRODUCTIVITY AND ERRORS IN TWO KEYING TASKS: 
A FIELD STUDY 
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Fic. 1. Distribution of 271 card punch operators according to average daily production rate. 


installation, and variability within operators. 
Many reasons could be cited to explain these 
differences but most would be speculative. 
We shall refrain from such speculation as 
much as possible. 

Some interesting consistencies in error rates 
are shown which immediately raise the hope 
of a simple model to describe at least some 
of human error making. 


DESCRIPTION MACHINES 


OF 


The card punch, or keypunch, machine is 
the size of a small desk and produces punched 
cards under keyboard control. It has an 
alphanumeric keyboard similar to a_ type- 
writer keyboard except that the numerals are 
located in a 3 X 3 matrix with the top row of 
the matrix at Keys u, i, and o on the right 
hand side of the alphabetic keyboard. The 
shift key serves to shift between alphabetic 
and numeric information rather than between 
upper and lower case. The card punch is 
capable of automatically punching informa- 
tion on one card which it reads from the 
preceding card. This duplicated information 
is not liable to keying errors and is not 
counted in measures of production on a key 
troke basis. 

The bank prool machine is a 
orting and totaling bank checks 
keyboards: one numeric 3 
a zero bar (similar to an machine ) 
and or 4X8 sorting keyboard 
coded by bank numbers. The operator keys 


for 
It has two 

3 keyboard with 
adding 


devi > 


one 4 X 6 


the amount of the check into the numeric 
keyboard, presses the appropriate sorting key 
and drops the check in a slot in the machine 
Because of the use of two keyboards and the 
check handling required, productivity on the 
bank proof machine cannot be compared di- 
rectly with card punching. 


PRODUCTION RATES 


Seven different card punch installations 
provided sufficient data to .make reasonable 
estimates of the average daily production of 
the average operator. These estimates range 
from 56,000 to 83,000 keystrokes per day. 
with 5 of the 7 in the 66,000 to 74,000 range. 
The average operator spends about 7 hours 
per day at the machine. The differences be- 
tween installations are due largely to dif- 
ferences in the work being punched 

Two card punch installations ran special 
speed tests of 20-30 minutes on 5 or more 
operators. Average performance on the 2 tests 
was 18.000 strokes per hour. or about twice 
that of the maintained rate over the working 
day. 

Six different banking installations provided 
sufficient production data to allow estimates 
of keying rates on bank proof machines. The 
range in daily production was about 4,350 to 
6,600 checks, or about 20,000 to 30,000 key 
strokes per day when an average of 4.5 key 
strokes is assumed for each check (this does 
not include the sorting keystroke). The 
operators spend an average of about 5 hours 
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per day actually entering checks. The differ- 
ences in production among installations is 
largely a matter of sorting requirements and 
face amounts of the checks handled. 


Distributions over Operators 


The individual differences among keypunch 
operators and proof machine operators are 
similar and may considered together 
Figures 1 and 2 the distribution 
production rates over operators on card punch 
and bank proof machines, respectively. Both 
show the number of operators who fall into 
class intervals of production rates. The effect 
of excluding operators with less than a year 
on the job is shown by the dashed line. 

Figures 1 and 2 tell the story which seems 
to hold for large installations. The frequency 
distribution curves are nearly bell-shaped and 
symmetrical. Since the distribution curves for 
production are close to normal it is reasonable 
to state a standard deviation for their vari- 
ability. For the experienced keypunch opera- 
tors of Figure 1 the mean is 87,000 key- 
strokes per day with a standard deviation of 
10,000 keystrokes. For the experienced proof 
machine operators of Figure 2 the mean 
production rate is 6,400 checks per day with 
a standard deviation of 860 checks. Thus, for 
both keypunch and bank proof operators the 
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standard deviation is approximately 12% 
the group mean. 


ol 


Variability within Operators 


In brief, the data of the present study 
provide the following estimates for within- 
operator variability in production: week-to- 
week production averages, for individual 
operators, fluctuate such that the standard 
deviation of these averages for each operator 
is about 6-10% of the group mean produc- 
tion, while monthly averages fluctuate with 
a standard deviation of about 3—5% of the 
group mean production (based on variance 
averaged over operators). This implies that 
the variability of an operator’s production is 
relatively independent of her mean production 
level. 

This variability within the individual oper- 
ators contributes to the spread of the distribu- 
tion in Figures 1 and 2, but it accounts for 
only a small fraction of the total variance 
observed between operators. This does not 
mean that within-operator variability is neg- 
ligible. Performance measures from keyboard 
operators do vary sufficiently from day-to- 
day, week-to-week, and even month-to-month 
to make consideration of this source of vari- 
ance important, particularly in evaluating in- 
dividual performance. 
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Fic. 2. Distribution of 459 bank proof machine operators according to average daily production rate 
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ERROR RATES 


The average error estimates, in terms of 
number of keystrokes per error, range from 
1,600 to 4,300 for 4 different card punching 
installations. In terms of percentage error, 
this is a range of .02% to .06%. These figures 
are for errors caught in an independent ver- 
ifying procedure. No data were available on 
errors which the operator herself detected 
and corrected. 

Only two of the bank proof machine instal- 
lations visited keep a record of errors and 
these records require a few words of explana- 
tion. Errors which are not detected by the 
operator immediately are caught by the 
operator herself in checking the total of her 
machine with supplied totals. These are the 
errors considered here. No errors in the cents 
position are recorded and some errors in the 
dimes position are also not counted (usually 
errors of 10 cents and 20 cents). No sorting 
errors are counted. Errors which could con- 
ceivably be due to poorly written numerals 
are also not counted. Within these rules, the 
counted errors average about 3,500 checks 
per error or .03% error per check. This error 
is considererably lower than that of any key- 
punch installation on which we have data. 
The difference in accuracy may be due to 
increased emphasis on accuracy, more im- 
mediate knowledge of errors, and different 
criteria for excusing errors in the proof ma- 
chine installations. 


Distribution over Operators 


The ranges of individual differences in er- 
rors among keypunch operators and proof 
machine operators are similar and may be 
considered together. Unlike production data, 
the units for measuring errors are not straight- 
forward. Two error measures are commonly 
used by the installations: (a) the percentage 
of items (cards or checks) in errors, and (0b) 
the number of items per error (or mean free 
path between errors). 

If the frequency distribution of operators 


were plotted against intervals of percentage- 


error, a skewed distribution results with most 
operators clustered at the low error end. If 
the number of items per error is used, an 
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even more skewed distribution results with 
most of the operators clustered at the high 
error end. Thus, we could apparently show 
that most operators clustered together in 
error rate with a few poor operators out in 
the tail of the distribution, or that most 
operators clustered together except for a few 
good operators out in the tail of the distribu- 
tion. Actually, each of these conclusions is 
valid for its own measure of error but the 
resulting skewed distributions do not allow 
the application of normal curve statistics. In 
addition, the within-operator variability, as 
measured by standard deviation of percent- 
age-error, is a linear function of the opera- 
tor’s mean error rate (as described below). 
Both of these findings suggest a logarithmic 
transformation. The log transform also has 
the nice property that the log distribution of 
errors is the same whether the raw scores 
are percentage-error or items per error. Since 
it is difficult to interpret error measures in 
logarithmic units, it may be better to plot 
percentage-error on a logarithmic scale. The 
distributions of undetected errors by opera- 
tors on card punches and proof machines are 
plotted in this fashion in Figures 3 and 4. 
Again, operators with 1 year or more of ex- 
perience are plotted separately from the 
entire group. 

The difference in performance between the 
best and worst operators is much more strik- 
ing in errors than in production. Namely, the 
ninetieth percentile operator makes 6-10 
times as many errors as the tenth percentile 
operator. The dotted lines indicate the tenth 
and ninetieth percentile points for each dis- 
tribution. 

There is a similarity in the shape of error 
distributions over operators at different in- 
stallations which is quite impressive even 
when the average error rates of the installa- 
tions are widely different. This similarity can 
be shown by transforming the error rates 
for several installations, so that the median 
error rates are all the same, and superimpos- 
ing the resulting error distributions. Four 
sets of data are used to show this similarity: 
the experienced operators of Figures 3 and 
4, the trainees of Figure 3 and a large group 
of students from a keypunch school after 
just 1 week of training. The four distributions 
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Fic. 3. Distribution of 271 card punch operators according to error rate determined by 10% sample 


verification over a 1-week period. (Only those errors found in verification are included.) 


are shown together after transformation in involve two different keyboards, different 
Figure 5. types of source documents, and the popula- 
The four tasks are all similar—that is, tions are quite different. So it seems curious 


they involve keyboard entry. However, they that the shape of the distributions is so nearly 
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Distribution of operators according to error rate for four different groups of operators. 


(Sampling periods range from 1 hour to 1 month with over 100 operators in each classification.) 


the same. Indeed, the only striking difference 
between the distributions is in average error 
rates before the data were transformed. 
Variability within Operators 

As in production distributions, the within- 
operator variability contributes to the spread 
of the distributions in Figures 3 and 4, but 
only accounts for about 10% of the total 
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variance. Unlike the production data, how- 
ever, the variability of an operator’s error 
rate is not independent of her mean error rate. 

The observed within-operator variability as 
a function of mean error rate is shown in 
Figure 6 for bank proof operators grouped 
according to mean error rate. The standard 
deviation for these operators is obtained by 
averaging the variance based on scores for 6 
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Fic. 6. Within-operator variability of error score as a function of mean error for 459 bank proof 


machine operators 


(Mean error is based on 6 months of data for each operator.) 
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consecutive months and taking the square 
root of the average variance. Figure 6 shows 
that the within-operator standard deviation 
of percentage-error approximates a_ linear 
function of Aer mean error rate. 


Poisson Model 


Since keying errors are low probability 
events, it is interesting to ask if observed 
differences in error rates were due to random 
fluctuations in observed frequency of a fixed 
probability event. The answer is that for 
between-operator differences, the fixed-prob- 
ability model would predict less than 5% of 
the observed variance. For within-operator 
variability the assumption of fixed within- 
operator error-probability predicts less than 
half of the observed variance. Thus, the dif- 
ferences in error-probability between opera- 
tors, and variation of error-probability within 
operators, are real and cannot be attributed 
to sampling fluctuations. 


RELATION OF SPEED AND ERRORS 


Since there is a 2-1 range in speed and a 
10-1 range in errors between operators, it is 
immediately interesting to ask if the fast 
operators make more errors. Analysis show 
just the opposite to be true. The operators 
who are better in speed also make fewer 
errors, although the correlations are far from 
perfect. For the keypunch data (one installa- 
tion) the correlation between speed and errors 
over all operators is —.42 and for bank proof 
machines this correlation is —.53. 


IMPROVEMENT WITH TRAINING 


First we must make a distinction between 
two methods of obtaining the learning curves. 
The best way to follow change in performance 
with practice is to follow the same operators 
over many months or years of work. Un- 
fortunately, this is not always possible since 
records are not usually available in this 
manner. Particularly for data over periods of 
years, we must depend upon another method. 
That is, to look at how long each operator has 
been on the job and to group operators by 
time intervals according to their starting 
dates. The intervals must be chosen so as to 
have a reasonable number of operators in 
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Fic. 7. Improvement in performance as a function 
of time on the job for 459 bank proof machine 
operators in one bank. (Plotted points are means for 
all operators falling within that interval of time on 
the job. Different operators are represented at each 
point.) 


each interval in order to reduce the variability 
due to individual differences. This considera- 
tion dictates a set of intervals increasing in 
size with increasing months-on-the-job, since 
normal turnover produces a lesser density 
of operators at the longer experience end of 
the curve. The main disadvantage of this 
second method is that the natural selectivity 
factors which cause operators to leave must 
operate differentially to some extent as a 
function of skill. Learning curves plotted 
by this second method include the influence 
of such selectivity factors as well as time on 
the job. 

Production and error rates, as a function of 
time on the job, are plotted in Figure 7 for 
one bank proof machine installation using the 
second method. The mean production and 
error rates for operators falling within each 
time interval are plotted against time-on- 
the-job. This, and similar plots for other 
installations, clearly shows continued signifi- 
cant improvement in both speed and accuracy 
during the first year on the job. Improvement 
after the first year is not clear in all instal- 
lations and may well be related to job 
difficulty. 


Comparison with Typing 


For short-run tests, speed on the card 
punch averages more than five strokes per 
second on tasks with no complications. Over 
the regular working day, averaging over jobs 
and operators leads to an average production 
of 2.8 strokes per second during time actually 
spent on the machine. For 7 hours per day 
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actually at the machine (out of an 
70,000 strokes per 
into typewriter language, 
these figures are equivalent to 60 words per 
minute for short runs with a daily average of 
34 words per minute for 7 hours of typing. 
It should be noted, however, that these figures 
are averages over time and that operators 
often key easy on highly practiced combina- 
tions (e.v., “the’’) at rates pressing the limit- 
ing speed of the machine (18-20 strokes per 
second ). 


day) this means about 
day. 


Translated 


KLEMMER AND G. 


8-hour 


R. LocKHEAD 


REFERENCES 
Corver, G. (Ed.) A guide to 
Detroit, Mich 
Assoc iation, 1960 
Hirurx, W. A, & 
key et design 
1961, No. 1023 
Rane, H. Typewriting research index: 1900-1954. 
Carbondale, Ill.: 807 Twisdale Avenue, 1954. 
West, L. J. Review of research in typewriting learn- 
ing with recommendations for training. USAF 
Train. Res. Cent. tech. Note, 1957, No. 57-69. 


office clerical time 


standards Systems and Procedures 


Conurn, R. 
USN 


Human factors in 
Electron. Lab. res. Rep. 


(Received December 12, 1961) 





Journal of Applied Psychology 
1962, Vol. 46, No. 6, 409-416 
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The validity of 2-scale pattern interpretation for the CPI was assessed within 
a college counseling service population. Groups representing high and low 
score combinations on the Dominance and Good Impression scales were con- 
stituted, and the self-descriptive adjectives from the Adjective Check List 
which differentiated these groups from a representative counseling service 
group were determined. These clusters of self-descriptive terms were generally 
consistent with the personality types which would be anticipated, based on the 
combined meanings of high and low scores on the individual scales as evidenced 


by high matching accuracy of 


expert 


judges. These results provide gross 


validational support for 2-scale pattern interpretation on the CPI. 


The availability of a valid multidimensional 
personality test for use in the assessment of 
the relatively normal (nonpsychiatric) popu- 
lation of college students who seek counseling 
is doubly important. Not only can the person- 
ality inferences be of substantial benefit in 
formulating early hypotheses about the client, 
but urgently-needed counseling research in- 
volving personality variables can be imple- 
mented. A series of investigations is currently 
being conducted to assess the validity of one 
relatively new personality test, the California 
Psychological Inventory (CPI) (Gough, 
1957), with college counseling service subjects. 
The initial interest in this instrument was 
based on two of its characteristics. For one, 
its 18 scales measure a wide range of inter- 
personal behaviors relevant to the relatively 
normal clientele of a counseling service. For 
the second, many of its scales were developed 
empirically, allowing a somewhat higher de- 
gree of confidence in their ultimate validation. 

Gough (1957, pp. 14-16) recommends and 
describes a five-step procedure for CPI pro- 
file interpretation, and the validational re- 
search of the current investigators has fol- 
lowed the same order. The first step in inter- 
pretation is an appraisal of overall elevation. 
Since the scales are nearly all keyed so high 
scores indicate positive behaviors and low 
scores suggest negative attributes, the overall 
profile elevation should be positively related 
to level of adjustment. Goodstein, Crites, 
Heilbrun, and Rempel (1961) found support 
for this assumption by showing the expected 
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profile elevation differences between three 
groups of college students clearly differing in 
level of adjustment (i.e., counseling service 
personal adjustment clients, counseling service 
vocational-educational clients, and college 
normals). 

Gough has grouped his 18 scales into four 
classes, and he suggests that the test inter- 
preter should, as a second step, note the 
differential elevations of these scale clusters. 
His groupings include: (a) “measures of 
poise, ascendancy, and self-assurance” (Domi- 
nance, Capacity for Status, Sociability, Social 
Presence, Self-Acceptance, and Sense of Well- 
Being); (0) “measures of socialization, ma- 
turity, and responsibility” (Responsibility, 
Socialization, Self-Control, Tolerance, Good 
Impression, and Communality); and (c) 
“measures of achievement potential and intel- 
lectual efficiency” (Achievement via Conform- 
ance, Achievement via Independence, Intel- 
lectual Efficiency); and (d) “measures of 
intellectual and interest modes” (Psycholog- 
ical-Mindedness, Flexibility, Femininity). Al- 
though not strictly a validational study, 
Crites, Bechtoldt, Goodstein, and Heilbrun 
(1961) did test the adequacy of Gough’s 
groupings by a factor analysis of the 18 
scales, the subjects again being both client 
and nonclient college students. In the main, 
Gough’s Groups a and 5 were extracted intact 
from the matrix of intercorrelations, but there 
was considerably less support for Gough’s 
Groups c and d. 

The third step in Gough’s recommended 
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approach to CPI interpretation is to note the 
high and low scale scores as one moves 
toward greater specificity in his inferences. 
Included in this mode of interpretation is the 
technique of two-scale pattern analysis ' 
which is presented as a “tentative” method 
in the manual. Two-scale pattern analysis 
involves the classification of individuals into 
four groups as a function of their concomitant 
deviation from some baseline on two selected 
scales. Thus, some would be high on both 
Scales X and Y, some high on X but low on 
Y, some low on X and high on Y, and some 
low on both X and Y. To be of any value, 
two-scale pattern analysis must provide the 
interpreter with valid inferences which are 
not available from the scores on either X or Y 
when considered independently. If it could 
be shown that the CPI could generate such 
valid and unique statements based upon rela- 
tive elevations of scale pairs, the breadth of 
the test’s usefulness would be considerably 
increased. The present study is concerned 
with assessing the validity of two-scale pat- 
tern analysis with the CPI. 


METHOD 
California Psychological Inventory Scales 


The CPI is comprised of 480 true-false items 
whose content primarily samples behaviors of a 
social interactional nature but also includes at- 
titudes toward achievement and authority. The two 
scales of the 18 included in the CPI which were 
selected for the pattern analysis were the Dominance 
(Do) and Good Impression (Gi) scales. These 
particular scales were chosen because they were 
previously found to represent best the two major 
factor analytically derived clusters (Crites et al., 
1961), having high loadings on their respective 
factors, and showing the least item overlap with 
scales in other factors. Gough (1957, p. 12) considers 
Do as a measure of “factors of leadership ability, 
dominance, persistence, and social initiative” and 
provides the following descriptions of the high and 
low Do scorer: 


1. High Do scorer—“aggressive, confident, per- 
sistent, and planful; as being persuasive and 
verbally fluent; as self-reliant and independent; 
as having leadership potential and initiative.” 

2. Low Do scorer—“retiring, inhibited, common- 
place, indifferent, silent, and unassuming; as 


1A similar interpretative technique termed “con- 


figural scoring’ was earlier suggested by Meehl 
(1950) at the item level on objective personality 
questionnaires. 
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being slow in thought and action; as avoiding 
situations of tension and decision; and as lacking 
in self-confidence.” 


The Gi scale is represented by Gough (1957, p. 12) 
as a measure “to identify persons capable of creating 
a favorable impression, and who are concerned about 
how others react to them.” The descriptions of high 
and low Gi scorers are: 


1. High Gi scorers—“cooperative, enterprising, 
outgoing, sociable, warm, and helpful; as being 
concerned with making a good impression; and as 
being diligent and persistent.” 

2. Low Gi scorer—“inhibited, cautious, shrewd, 
wary, aloof, and resentful; as being cool and 
distant in their relationships with others; and as 
being self-centered and too little concerned with 
the needs and wants of others.” 


Considering the implications of high and low 
scores on both scales, it would be anticipated that 
certain unique behavioral attributes would emerge 
when taken in combination. The anticipated pat- 
tern typologies are: 


1. High Do-high Gi—This person will assert 
himself in interpersonal relationships so as to 
assume supraordinate roles but will do so tactfully 
and in such a way as to initiate and sustain the 
high personal regard of those who are subordinated 
to him. His satisfactions stem from initiating 
actions which do things for others (“benevolent 
leader” type). 

2. High Do-low Gi—This person will assert 
himself in interpersonal relationships so as to 
assume supraordinate roles but will do so aggres- 
sively and without concern for the personal feel- 
ings of those whom he subordinates. His satis- 
factions stem from initiating actions which do 
things to others (“malevolent dictator” type). 

3. Low Do-high Gi—Conflicted about social 
participation, this person will seek social relation- 
ships which do not require initiative or responsi- 
bility but which will put him in a position to 
obtain social rewards. This is the person who 
blends into his social background. (“He always 
seems like such a nice person—wonder what his 
name is?” type). 

4. Low Do-low Gi—This person is socially aloof, 
even withdrawn and resentful, making no pretenses 
about being interpersonally active. Self-centered- 
ness brings few rewards except to escape the threat 
of social demands for which he lacks motivation 
or skills (“disgruntled recluse” type) 


Subjects 


The basic pool of subjects for this study was 947 
clients at the University Counseling Service, Uni- 
versity of Iowa. This number included 638 males 
and 309 females and was divided in about a 5:1 
ratio of vocational-educational to personal adjust- 
ment counseling cases. Each had been given the CPI 
as part of the standard intake battery. 
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Procedure 


Assignment to the four pattern classes was in- 
strumented by first estimating male and female col- 
lege means and standard deviations for the Do 
and Gi scales. Gough (1957) had provided college 
norms which indicate male means to be 53 and 47, 
respectively, and female means to be 53 and 48, 
respectively. The sigma is 10 in each case. High or 
low in the present study was defined as deviating 
more than a half sigma (> 5) above or below the 
college mean. Based on this definition, the numbers 


Do-high Gi, N = 27; low Do-low Gi, N= 129. Of 
the 309 total females, the high Do-high Gi group 
included 22; high Do-low Gi, 18; low Do-high Gi, 
15; and low Do-low Gi, 64. 

Stratified samples of “counseling clients in gen- 
eral” relative to concomitant elevations of the Do 
and Gi scales were then constituted as reference 
(comparison) groups. The male reference group in- 
cluded 110 clients whose Do and Gi scores did 
not place them into any of the four pattern groups 
and, in addition, proportions of subjects from the 
four pattern groups based upon the prevalence of 


out of 638 total in the four male groups were: high 
Do-high Gi, N = 31; high Do-low Gi, N= 35; low 


these two-scale patterns in male counseling clients. 
For example, 129 out of 638 (20%) male clients 


TABLE 1 


SELF—-DESCRIPTIVE TERMS DIFFERENTIATING HIGH DomiInaNt—-Hicu Goop IMPRESSION MALE AND 
FEMALE CLIENTS FROM REPRESENTATIVE CLIENT Group 


Male high Do 
high Gi 
More: 


(Active 
Adaptable 

Adventurous 
Ambitious 
Confident 
Determined 
loresighted 
Generous 
Individualistic 
Industrious 
Inventive 
Jolly 
Original 
Patient 
Progressive 
Resourceful 
Self-confident 
Spunky 
Strong 
Talkative 
Wise 


Male high Do 
high Gi 
Less: 


Anxious 
Careless 
Complaining 
Confused 
Cynical 
Defensive 
Dissatisfied 
Distractable 
Dreamy 
Emotional 
Evasive 
Excitable 
Hasty 

High strung 
Hurried 
Immature 
Impatient 
Irritable 
Moody 
Nervous 
Pessimistic 
Prejudiced 
Self pit ving 
Silent 
Spendthrift 
Suspicious 
lremperamental 
lense 
Pouchy 
Unambitiou 
Unstable 
Withdrawn 
Worrying 


Female high Do 


Female high Do 


high Gi high Gi 
More Less 


Contented Anxious 
Civilized 
Confused 
Conservative 
Curious 
Defensive 
Dependent 
Dissatisfied 
Fasy-going 
Emotional 
Fair-minded 
Forgiving 
Fussy 
Good-natured 
Healthy 
Lazy 
Leisurely 
Loyal 
Moody 
Pessimistic 
Precise 
Restless 
Serious 
Silent 
Simple 
Sincere 

Slow 
Soft-hearted 
Stubborn 
Submissive 
lalkative 
limid 
rolerant 
Unassuming 


Withdrawr 
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TABLE 2 
SeLF-DESCRIPTIVE TERMS DIFFERENTIATING HiGH DomInANt-Low Goop ImpRESSION MALI 
AND FEMALE CLIENTS FROM REPRESENTATIVE CLIENT GROUPS 


Male high Do 
low Gi 
More: 


Male high Do- 
low Gi 
Less: 


Adventurous Commonplace 
Aggressive Conservative 


\loof 


Argumentative 


Contented 
Dull 
Easy-going 
Modest 


Peaceable 


Assertive 
Clev er 
Confident 
Demanding Shy 
Egotistical Silent 
Enterprising Simple 
Forceful Quiet 
Humorous 

Impulsive 

Intolerant 

Mannerly 

Outspoken 

Polished 

Rational 

Resourceful 

Self-confident 

Sentimental 

Severe 

Sharp-witted 

Show-off 

Shrewd 

Spontaneous 

Spunky 

Stubborr 

Suspicious 

lalkative 

Versatile 

Witty 


showed the low Do-low Gi pattern; accordingly, 
21 (20% of 110) low Do-low Gi subjects were 
included in the male reference group. The stratified 
male reference group and a similarly constituted 
stratified female reference included 138 and 
150 subjects, respectively 

In addition to the CPI, each client had also been 
administered the Gough Adjective Check List (ACL) 
(Gough & Heilbrun, in press) as part of the counsel 
ing service intake battery, which test requires the 
person to check those adjectives deemed self-char 
acteristic. The validational procedure employed in 
the present study was to determine which of the 306 
were differentially endorsed as_ self 
by each of the pattern groups rela- 
tive to the appropriate reference group; then, the 
psychological clusters 


group 


adj ctiv es 
characteristic 
adjective 


meanings of these 


Female high Do- 
low Gi 
Less: 


Female high Do 
low Gi 
More 

Assertive Adaptable 

Commonplace Calm 

Complicated Conscientious 

Cynical Cooperative 

Daring Considerate 

Demanding Dependable 

Disorderly Honest 

Dominant Independent 

Quiet 


Sincere 


Egotistical 
Enterprising 
Fault-finding Slow 
Fearful Timid 
Forceful Undependable 
Friendly Withdrawn 
Immature 

Ingenious 

Mischievous 

Opinionated 

Opportunistic 

Optimistic 

Original 

Outspoken 

Quick 

Sarcasti 

Shrewd 

Sociable 

Sophisticated 

Spontaneous 

Spunky 

Wary 


were related to the pattern typologies implied by 
the combined meanings of the individual Do and Gi 
scales. 

More specifically, 35 judges (including 15 PhD 
psychologists from southern Iowa and 20 advanced 
graduate students in psychology at the University 
of Iowa) were asked to match the adjective clusters 
to the typologies. Male and female analyses were 
conducted separately since it remained an empirical 
question whether the traits measured by the Do and 
Gi scales or their combined patterns would be mani 
interpersonally in the ways for both 
Thus, each judge matched the four adjective 
clusters distinguishing the pattern groups with the 
four pattern typologies independently for males and 
females. The percentage of accurate matchings rep 
resents the validating statistic 


fested same 


sexes 
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RESULTS AND DISCUSSION 


Chi square analysis was used to determine 
which ACL adjectives were differentially en- 
dorsed by each pattern group relative to a 
reference group with the p < .05 level re- 
quired for significance. The self-descriptive 
terms which differentiated the high Do-high 
Gi male and female groups from their refer- 
ence groups are given in Table 1. The pre- 
dicted typology is well supported in the case 
of high Do-high Gi males, since outgoing 
leadership qualities as well as a regard and 
concern for others are consistent attributes 
of this class of clients. The high Do-high Gi 
females do not present as clear-cut a pattern 
of endorsement, however. There is a sugges- 
tion of interpersonal dominance in _ their 
denial of passivity, but there is also an un- 
expected denial of attributes which serve to 
elicit favorable social responses. 

The adjectives distinguishing high Do-low 
Gi clients from the reference groups are pre- 
sented in Table 2. The descriptive terms for 
the high Do-low Gi males are quite com- 
patible with the predicted pattern typology. 
The outgoingness, initiative, and leadership 
qualities are intermixed with antagonistic 
terms like aggressive, argumentative, asser- 
tive, egotistical, forceful, and outspoken, none 
of which characterized the high Do-high Gi 


males. The high Do-low Gi female clients also 
provide a pattern of self-descriptions strik- 
ingly consistent with typology both in terms 
of the anticipated dominating qualities and 
their aggressiveness toward those whom they 
would presumably dominate. 

Table 3 gives the adjectives differentiating 
the low Do-high Gi male and female clients 
from their respective reference groups. Al- 
though there were considerably fewer adjec- 
tives distinguishing this type of client, the 
predicted typology of the nonforceful, un- 
distinguished person who avoids interpersonal 
responsibilities but seeks social approval 
emerges for both sexes. It is interesting that the 
constriction implied by this typology appears 
in the guise of a general cautiousness for 
the males (painstaking, stern, thrifty, less 
hasty) and as a lack of emotional involve- 
ment for females (unemotional, less affection- 
ate, less cheerful, less serious, less tense). 

The distinguishing personological terms for 
the low Do-low Gi clients are found in 
Table 4. Inspection of these lists provides a 
convincing array of terms portraying the 
withdrawn, socially inept, resentful male or 
female and thus provides support for the 
pattern typology. 

The percentage of the 35 judges accurately 
matching each adjective cluster with the ap- 


PABLE 3 


SELF-DESCRIPTIVI 


TerMS DIFFERENTIATING Low DOMINANT 


Hicu Goop ImpREssION MA 


AND FEMALE CLIENTS FROM REPRESENTATIVE CLIENT GROUPS 


Male low Do 
high Gi 


Less: 


Male low Do 
high Gi 
More: 

Boastful 


Confused 


Forgetful 


Friendly 
Painstaking 


stern 


Dependent 
gotistical 
Strong nthusiastic 
Thrifty Flirtatious 
Forceful 
Hasty 
Methodical 
Show-off 
Spendthrift 
Sutbborn 
Suspic ious 


louchy 


Female low Do 
high Gi 


Less 


Female low Do 
high Gi 
More: 


Fatient 


Affectionate 
Ouiet j 


Aggre ive 
Unemotional Cheerful 
Clever 
Idealistic 
Lazy 
Mannerly 
Outgoing 
Outspoken 
»eTious 
Suggestible 


lense 
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TABLE 4 


SELF—DEscRIPTIVE TERMS DIFFERENTIATING Low Domrnant-Low Goop IMPRESSION 
MALE AND FEMALE CLIENTS FROM REPRESENTATIVE CLIENT GROUPS 


Male low Do 
low Gi 


More: 


Absent-minded 
Awkward 
Bitter 
Careless 
Changeable 
Complaining 
Complicated 
Confused 
Despondent 
Dissatisfied 
Distrustful 
Dreamy 
Emotional 
Gloomy 
High-strung 
Immature 
Impatient 
Inhibited 
Interests narrow 
Intolerant 
Irritable 
Lazy 

Moody 
Nervous 
Preoccupied 
Quitting 
Reckless 
Restless 
Retiring 
Shy 

Silent 

Slow 
Tactless 
Temperamental 
limid 
Touchy 
Unintelligent 
Wary 

Weak 
Withdrawn 


Worrying 


Male low Do 
low Gi 
Less: 


Active 
Adaptable 
Affectionate 
Aggressive 
Alert 
Ambitious 
Assertive 
‘alm 
‘apable 
“heerful 
‘lear-thinking 
‘lever 
‘onfident 
Contented 
‘ooperative 
“ourageous 
Determined 
Dominant 
Efficient 
Energetic 
Enterprising 
Enthusiastic 
Forceful 

] oresighted 
Friendly 
Healthy 
Helpful 
Honest 
Humorous 
Industrious 
Ingenious 
Initiative 
Insightful 
Interests wit 
Logical 
Masculine 
Mature 
Methodical 
Natural 
Opportunistic 
Optimistic 
Persistent 
Pleasant 
Poised 
Practical 
Precise 
Progressive 


Realistic 


Female low Do 
low Gi 
More 


\bsent-minded 
Aloof 
Anxious 
Bitter 
Careless 
Changeable 
Complaining 
Confused 
Defensive 
Despondent 
Dissatisfied 
Dreamy 
Egotistical 
Fearful 
Gloomy 
Healthy 
Immature 
Impatient 
Indifferent 
Infantile 
Inhibited 
Intolerant 
Irresponsible 
Irritable 
Lazy 

Meek 

Moody 
Nervous 
Pessimistic 
Quitting 
Rebellious 
Resentful 
Retiring 
Selfish 
Self-punishing 
Sexy 

Sulky 

Tactless 

lemperamental 

Tense 

Fouchy 
Unambitious 
Undependabl 


Withdrawn 


Female low Do 
low Gi 
Less: 


Aggressive 
Alert 
‘apable 
‘alm 
‘heerful 
Determined 
Efficient 
snergetic 
Enthusiastic 
Good-naturec 
Industrious 
Initiative 
Inventive 
Natural 
Out-going 
Patient 
Persevering 
Pleasant 
Poised 
Progressive 
Quiet 
Realistic 
Reliable 
Resourceful 
Robust 
Self-confident 
Sociable 
Stable 
ralkative 
Zany 
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Table 4—Continued 


Male low Do 
low Gi 
More: 


Male low Do- 
low Gi 
Less: 


Reasonable 
Relaxed 
Reliable 
Resourceful 
Responsible 
Self-confident 
Self-controlled 
Shrewd 
Sincere 
Sophisticated 
Stable 
Steady 

Stern 

Tactful 
Thorough 
Thoughtful 
Thrifty 
Trusting 
Understanding 
Uninhibited 
Unscrupulous 
Unselfish 
Versatile 
Wholesome 
Witty 


propriate typology is given in Table 5. The 
typologies anticipated on the basis of the 
combined meanings of high and low scores on 
the Do and Gi scales were systematically and 
accurately matched with the patterns of in- 
dependently obtained self-descriptions for 
both males and females as evidenced by high 
degrees of accuracy ranging from 74% to 
97% for the eight matchings (average per- 
centage of accuracy = 88). These figures were 
sufficiently high so as to obviate tests for 
statistical significance, since random match- 
ing of adjective clusters to typologies should 
result in but 25% accuracy. Although the 
procedure used in this study for validating 
two-scale pattern CPI interpretation is crude, 
amounting as it does to matching experts’ 
judgments of global meanings for empirically- 
derived clusters of self-descriptive terms with 
anticipated two-scale pattern typologies, there 
would probably be little argument with the 
conclusion that the results are generally 
positive. 


Female low Do 
low Gi 
Less: 


Female low Do 
low Gi 


More: 


The investigators further recognize that 
the findings of the present study represent 
systematic relationships between two sets of 
self-descriptive behaviors. Although it might 
be argued that such findings should be con- 
structed as bearing upon consistency of self- 
description (reliability) rather than validity 
of two-scale pattern analysis, it is felt that 
either interpretation of the results should 
enhance confidence in CPI pattern analysis. 


TABLE 5 
PERCENTAGE OF JUDGES 
ADJECTIVE CLUSTERS WITH 
ACTIONAL TYPOLOGIES 
N = 35) 


CorRRECTLY MATCHING 


APPROPRIATE INTER 


ional typology 


High Do- 
high Gi 


High Do Low Do 
low Gi high Gi 

Sex judged (%) 7.) 

Male 91 

Female 74 
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Since one of the scales (Gi) chosen for 
investigation was derived as a validity check 
for the CPI to detect persons trying to por- 
tray themselves in an unduly favorable light, 
the question may be raised as to whether the 
findings merely represent a distinguishing of 
high and low dominant groups who differ in 
the degree to which they are willing to por- 
tray themselves unfavorably on the test. Such 
an interpretation presumes that the tendency 
to portray oneself favorably is not a gen- 
eralized trait but rather is specific to a psy- 
chometric situation. Gough’s (1957) inter- 
pretation of elevations on Gi is that “scores 
somewhat above average .. . are indications 
of favorable attitudes and conscientious ef- 
forts to fit in and to adapt. Very high scores 
raise the possibility of the test ‘faking,’ or of 
an undue concern with making a good im- 
pression” (p. 19). In either case, Gough’s 
remarks seem best interpreted as suggesting 
a generalized trait of seeking social approval 
for one’s behavior, and there is now evidence 
supporting this position. Two studies have 
found that giving socially desirable responses 
in a specific testing situation is not a source 
of error in predicting nontest behaviors 
(Heilbrun, 1962; Heilbrun & Goodstein, 
1961b). Heilbrun and Goodstein (196la) re- 
port that the social desirability values at- 
tached to test trait statements are themselves 
predictive of nontest behavior. Finally, it was 
found that the degree to which a person’s 
test responses are related to social desirability 
is predictive of the degree to which his social 
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behavior is oriented toward creating a favor- 

able impression (Marlow & Crowne, 1961). 

Thus, there is good reason to presume that 

the trait measured by scales such as Gi is a 

generalized one and that the Do-Gi typologies 

have predictive significance beyond the im- 

mediate testing situation as well. 
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The validity of weighted application blank scores in predicting length of service 
of female office personnel of large midwestern manufacturing company 
showed a slow but consistent decline from 1954 to 1959. After reweighting the 
application blank variables by the usual procedure, a Pearson r of .39 was ob 
tained between WAB scores and tenure on a cross-validation sample of 208 
individuals. Only 3 variables (high proficiency at shorthand; did not leave last 
job because of pregnancy, marriage, sickness, or home problems; and will begin 
work on the new job 1 week or more from now) retained their predictive 
validity from 1954 to 1959. Some of the variables were assigned different 
weights, and others were given weights for the Ist time. It was recommended 
that weights assigned to application blank responses be reviewed at least every 


a 


3-5 years. 


In recent years, the weighted application 
blank has come into increasing prominence as 
a selection device in industry. This trend re- 
flects, in part, the desire to express selection 
methods in quantitative terms, and in part, 
the increasing recognition that the application 
blank has potential value beyond its use as 
anecdotal information. England (1961) pre- 
sents a detailed account of the methodology 
of the development of a weighted application 
blank, as well as an extensive list of refer- 
ences in this area. Of those studies using turn- 
over as the criteriori, Pearson r’s near .40 have 
generally been reported. 

Reports of long-term studies of the validi- 
ties of weighted application blanks are virtu- 
ally nonexistent in the literature. Perhaps the 
need for subsequent review of such validities 
is too obvious to require mentioning. At any 
rate, when turnover is used as the criterion 
it is certainly not to be expected that the 
same application blank information, for in- 
stance, highest past salary, should indefinitely 
retain its predictive validity for new job ap- 
plicants. 

The purpose of this report is to present the 
results of a re-evaluation of the weighted ap- 
plication blank developed by Kirchner and 
Dunnette (1957) on the basis of female of- 
fice personnel hired in 1954. The female office 
personnel included in this study held essen 
tially the same types of jobs as those included 
in the earlier study, and in both instances, 


$17 


were employees of the same large midwestern 
manufacturing company. Dunnette, Kirchner, 
Erickson, and Banas (1960) have already re- 
ported 1- and 2-year follow-ups on this same 
set of application blank weights. Their re- 
sults indicated that the predictive validity, 
while fairly high, had decreased somewhat 
from that of the initial study. 


METHOD 


As a starting point for this study, a sample of ap 
proximately one-fourth of the weighted application 
blank scores of the female office employees hired in 
1959, for the home office, was correlated with tenure 
A tetrachoric r of .07 was found, indicating that the 
predictive value of the variables weighted in 1954 
had deteriorated considerably. It was decided to at- 
tempt a reweighting of the application blank re- 
sponses. 

The application blanks for all new female office 
workers hired during 1959 were divided into two 
groups and systematically reviewed. Those hired dur- 
ing the first half of the year were used for the main 
part of the study, while those hired during the last 
half of 1959 comprised the holdout, or cross-valida 
tion group. As in the initial study, length of service 
was chosen as the criterion. The primary sample was 
grouped as follows: 5 months and under (N = 75), 
6-18 months (V=53), 19 months and over (N 
83). Tenure was divided in this way because of 
breaks in the distribution at the 6 19 
month points. 

Using the traditional approach, application blanks 
of the long-term group were compared with those of 
the short-term group on a total of 37 variables. Of 
these, 16 were found to differentiate, on the basis of 
at least a 10% difference in the frequency of re 
sponses, between the two groups. Weights of —1, 0, 


clear and 
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and 1 were then assigned to responses for each vari- 
able. Total scores were not computed for the appli- 
cation blanks used in deriving the weights, but all 
three (long-, medium-, and short-term) cross-valida- 
tion groups were scored on the 16 weighted variables, 
and total scores were obtained. This cross-validation 
sample was grouped as follows: 5 months and under 
(N=71), 6-18 months (VY=61), 19 months or 
more (N = 76). 


RESULTS AND DISCUSSION 


From Table 1, it may be observed that the 
new total scores do effectively differentiate 
between the long- and short-term groups, 
with the long-term group receiving, on the av- 
erage, higher scores than did the short-term 
people. The difference between the means is 
highly significant statistically, in this, the 
cross-validation sample. The relatively small 
overlap found provides impressive evidence 
that these 16 weighted variables are effective 
in differentiating the long- from the short- 
term employees. It was found that 84% of 
the long-term group equal or exceed the me- 
dian of the short-term group, and none of 
the long-term group scored below a —2, or 
Q, of the short-term group. A product-mo- 
ment 7 of .39 was obtained when length of 
service was correlated with these new weighted 
application blank total scores. This coefficient 
compares favorably with those found in other 
studies of this kind. Since some of the vari- 
ables used in deriving the old application 
blank scores were also included in the new 
set of weighted variables, it is evident that 
the office employees had already been par- 
tially screened. This situation would, of 
course, tend to produce an apparent shrink- 
age of the obtained validity coefficient. 

From the results of this study, it is readily 
apparent that scoring weights based on ap- 
plication blank responses need to be re-evalu- 
ated from time to time. There were some vari- 
ables in this study that had to be assigned 
different weights from those assigned in the 
earlier study, and there were several variables 
that operated in 1959 to differentiate long- 
term from short-term employees that did not 
do so in 1954. There were also a few vari- 
ables that still held up, and in the same way, 
from the 1954—59 groups. 

The variables which were weighted differ- 
ently include length of time in last position, 
number of past positions, age, and other office 
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TABLE 1 
QUARTILES AND MEANS OF WEIGHTED SCORES FOR 
LONG- AND SHORT-TERM OFFICE EMPLOYEES HIRED 
tN Last HAF oF 1959 
(Cross-validation group) 


Median (Q; M SD 


Group ?1 


Short 3 80 
3.84 


3.72 


Long 6 3.44 


training. The new weights for these variables 
indicate that the long-term employee in 1959 
was an older, more experienced individual 
than her 1954 counterpart. Among the new 
variables which were found to differentiate on 
the tenure criterion were average high school 
grade, type of work in last position, length of 
time expected to stay with the company, 
salary expected, position desired, and an evi- 
dence of leadership statement. It appears that 
the long-term employee, having been dissatis- 
fied with her salary and chances to advance 
in her previous job, took the advice of rela- 
tives to join this company, where she expects 
to advance in both salary and position. There 
were three variables which consistently held 
up in the same way from 1954 to 1959, in- 
cluding the 1956 follow-up study. These vari- 
ables are high proficiency at shorthand; did 
not leave last job because of pregnancy, mar- 
riage, sickness, or home problems; and will 
begin work on the new job 1 week or more 
from now. This group of variables suggests 
that the long-term female job applicant is 
still working on her previous job, but in- 
tends to leave it, if the new job meets her ex- 
pectations for advancement. 

Tetrachoric r’s between total application 
blank scores and tenure have been computed 
by Dunnette et al. (1960) as follows: 1954 
.74, 1955—.61, 1956—.38. The 1955 group 
was a cross-validation group, and the 1956 
correlation was based on a follow-up study. 
The tetrachoric r of .07 obtained in the pres- 
ent study, based on the same weights, indi- 
cates that there was a slow but continuous 
deterioration of the ability of the weighted 
application blank scores to differentiate long- 
from short-term employees. After a period of 
5 years, the results of using these scores are 
little better than chance. Scores based on the 
revised .weights and set of variables, when 
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computed on the cross-validation group, show 
a tetrochoric r of .57 with tenure. 

The maximum time that a given set of 
weights can safely be used without review 
probably depends upon a large number of 
factors, among them economic conditions, 


locale, type of industry, selection ratio, the 
criterion used, etc. It seems safe to say, how- 
ever, that weights assigned to application 
blank responses ought to be reviewed at least 
every 3-5 years. 
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MOTION PREDICTION AS A FUNCTION OF TARGET 
SPEED AND DURATION OF PRESENTATION * 


EARL L. WIENER 


University of Miami 


This study investigated the ability of Ss to predict the future position of a 
moving target after the target disappeared. Target speed, duration of target 
exposure, and S’s mode of responding to the visible target were varied. The 
performance measure was the absolute deviation from the correct target posi- 
tion at the end of 9 sec., converted to error relative to target speed. Results 
show: (a) no significant differences resulting from mode of response (tracking 
vs. monitoring), order of presentation, duration of presentation, or speed-dura- 
tion interaction; (b) significant learning effect from session to session (p < .01) ; 
and (c) an increase in relative error, in an inverse relation to target speed (p 
< .01). It is concluded that a human operator may be able to make motion 
predictions equally as well with minimal as with maximal exposure to target 
input; only target speed exerts an influence on prediction accuracy 


Prediction of the future position of a mov- 
ing target is an essential task of the human 
operator in any system in which he monitors 
or controls a dynamic, continually-varying 
process. Prediction may be defined as an ex- 
rapolation to a future position from current 
information on the state of the system and 
probable changes in that state. The efficiency 
of a system is, to a large degree, dependent 
on the success with which an operator can 
anticipate its future state. 

Prediction is especially important when in- 
put information or feedback loops are subject 
to degradation as, for instance, in the occur- 
rence of functional breakdown of equipment. 
In such an emergency, if the operator is to 
continue functioning in the system, he must 
make prediction based on prebreakdown in- 
puts. This is particularly true of radar dis- 
plays, where even with the equipment func- 
tioning properly, the target under surveillance 
may temporarily disappear in scope clutter. 

Several authors (Bowen & Woodhead, 1953, 
1955: McGuire, 1956; Manglesdorf, 1955; 
Manglesdorf & Fitts, 1954a, 1954b; Schipper 
& Versace, 1956) have investigated man’s 

1 This research was supported in part by the United 
States Air Force under Contract No. AF 33(616)- 
3612 with the Ohio State University Research Foun- 
dation, and was conducted in the Laboratory of 
Aviation Psychology. This report is based upon the 
thesis submitted in partial fulfillment of the require- 
ments of an MA degree at Ohio State. The author is 
indebted to G. E. Briggs who served as his adviser. 


ability to make predictions of future position 
on a static display. Generally these authors 
have reported that accuracy of prediction 
varies inversely with the distance to be extra- 
polated, but is unaffected by the length of 
the initiating target which represents speed.’ 
Using a dynamic display, Gottsdanker (1952a, 
1952b, 1955) demonstrated a phenomenon 
which he called “rate smoothing”: the sub- 
jects (Ss) tended to underestimate accelerat- 
ing targets and overestimate decelerating tar- 
gets. Accuracy was very high on constant rate 
targets. 

The present study investigated the effect of 
target speed, duration of exposure, and mode 
of response on prediction of future position 
of constant-rate targets following disappear- 
ance of the target. 


METHOD 
Apparatus 


The apparatus was an adaptation of that used by 
Gottsdanker (1952a). A moving target was produced 
by driving a chart with a diagonal pencil line under 
a 2 mm. slit in an aluminum plate. The plate was 


2 It is interesting that one of the first pilot selec- 
tion devices involved motion prediction with a static 


display. Stratton, McComas, Coover, and Bagby 
(1920) report the use of such a device in selecting 
World War I aviators. The subject was required t 
estimate where one branch of a parabolic curve 
would intersect a horizontal line. This was thought 
to be an analog of the landing task. The correlation 
between scores of this test and flight instructors’ 
ratings was .05. 
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Fic. 1. A sample, stimulus. 


flush-mounted in the top of a plywood box which 
held the drive mechanism, an Esterline-Angus Model 
38-D chart drive. The targets were drawn on blank 
Esterline-Angus chart paper. The target appeared as 
a dot moving from left to right through the slit. 


Stimuli 


Four durations of exposure (2, 4, 8, and 16 sec- 
onds) and four speeds (.5, 1, 2 and 4mm/sec) were 
combined forming 16 unique combinations of stimu- 
lus lines. The various speeds were produced by vary- 
ing the slope of the target line and the durations by 
the length of the line. 

Each target appeared in the extreme left of the 
slit remaining stationary for 5 seconds before begin- 
ning its left-to-right travel. Nine seconds after the 
disappearance of the target a red dot appeared on 
the extension of the target line. This indicated the 
end of a trial and provided knowledge of results at 
the terminal point. Five seconds later a new target 
appeared at the left. A complete set of the 16 speed- 
duration stimuli comprise a “replication” of the ex- 
periment. The order of presentation of the 16 stimuli 
was determined by means of a random number table 
for each replication. A sample of the stimulus tape 
is shown in Figure 1. 
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Sub je cts 


The Ss were 10 male undergraduates at the Obio 
State University. They were chosen from a list of 
students who had contacted the laboratory seeking 
employment and were paid one dollar per session. 
None had previous experience in tracking, motion 
prediction, or radar. 


Procedure 


Under the tracking condition, S$ traced the visible 
target in the slit with a pencil and continued tracing 
its predicted position until] the trial ended. Under the 
monitoring condition, S simply watched the target 
with the pencil in his hand and then began tracing 
its predicted position after it disappeared. From the 
time that the target disappeared, the two conditions 
were identical. 

The 10 Ss were randomly assigned to two groups. 
Group A began with the tracking condition and 
Group B with the monitoring condition. Each S$ 
participated in the experiment for 5 days, the first 
being devoted to instructions and two practice repli- 
cations under the initial response condition. On the 
second and third days S ran 3 replications each day 
under his initial response condition. On the remain- 
ing 2 days he ran 3 replications per day under the 
opposite condition. No practice was given for the 
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Fic. 2. Mean relative error by sessions and groups. 
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TABLE 1 
LATIN SQUARE ANALYSIS 


Source df MS 


Conditions 79 
Groups (order 671 
616 
420 
Error 8 34 


Sessions 


Subjects/Groups 


Total 


** > <.01. 


transfer condition. An entire replication took about 
8 minutes. After each replication S received a 5- 
minute rest period. 

The responses were scored by extending the target 
line to the terminal point, and measuring to the 
closest millimeter the absolute distance from the 
terminal point to S’s terminal estimate. The mean of 
each S’s six scores under each speed-duration-condi 
tion combination was computed and formed the ba- 
sis for the analysis. Thus each data point was the 
mean of six independent observations by each S. 


RESULTS 
The mean of each S’s six measurements in 
terms of absolute error was converted to rela- 
tive error by dividing each mean by the dis- 
tance traveled in the 9 seconds that S was 
making his predictions. For example, an abso- 
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Fic. 4. Mean relative error as a function of duration 
and speed: Session II. 


lute error of 9 mm. for a 4 mm/sec target was 
equal to 9 mm/36 mm or a 25% relative 
error. 

The mean relative error by groups and ses- 
sions (averaged across all 16 stimulus pres- 
entations) is shown in Figure 2. The data are 
analyzed by a 2 X 2 Latin square design as 
outlined by Grant (1948). The results of this 
analysis are shown in Table 1. These results 
indicate no difference between response con- 
ditions or order of presentation (groups), but 
only a significant learning effect from Ses- 
sion I to Session II and individual differences 
within groups. 

TABLE 2 
ANALYSIS OF VARIANCE FOR SESSION I 
(First 6 trials) 


Source y MS 
Groups (G 9,630 
5,082 
26,911 


Subjects/Groups 
Speeds (S) 

SXG 2,377 
Error 1,846 
Durations (D) 3 807 
DXG 1,547 
Error 485 
Sx D 519 
SXDxXG 360 
Error 502 


14.6*** 
1.29 


1.77 


Total 


*> <.05. 
*** > <.001. 
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TABLE 3 


ANALYSIS OF VARIANCE FOR SESSION II 
(Second 6 trials) 


Source MVS 


Groups 
Subjects/Groups 
Speeds 

SXG 

Error 

Durations 
DXG 

Error 

SxXD 

sx DxG 


Error 
Total 


*** > <.001 


Since the sessions dimension was the only 
main variable demonstrating statistical sig- 
nificance, the two sessions were analyzed 
separately for speed and duration effects. 
These analyses of variance took the form of 
a Lindquist Type VI design (Lindquist, 
1953) with four speeds, four durations,’ and 


two response conditions. Each S performed 
under all of the 16 speed-duration combina- 
tions, but was nested in one of the response 
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" (tracking-monitoring) conditions. These re- 
sults are displayed as three-dimensional plots 
in Figures 3 and 4. These plots indicate the 
marked effect of the speed variable and the 
lack of influence of duration of presentation. 
This is borne out in the analysis of variance 
presented in Tables 2 and 3. In both analyses, 
the speed variable was highly significant while 
the duration variable and the speed-duration 
interaction were not. Again response condi- 
tions failed to produce significant differences. 


DISCUSSION 


This study demonstrated the marked effect 
of target speed upon motion prediction accu- 
racy with constant-rate targets. Previous in- 
vestigations utilized static displays and failed 
to produce differences attributable to target 
speed. But on a static display speed of the 
initiating target is represented only by anal- 
ogy, by varying the length of the trace line, 
or number of blips. It is highly questionable 
whether the subjects perceive this as speed at 
all, whereas with a dynamic display the sub- 
jects are exposed to a true sample of target 
motion. 

An interesting result from this study is the 
lack of influence of duration of target pres- 
entation. It is surprising that the operator is 
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able to make his prediction as accurately 
from a 2-second sample of target motion as 
from a 16-second sample. This result tends to 
support the view of Bowen and Woodhead 
(1953), who state: “As long as an observer 
has a minimum of information, he does not 
or cannot utilize any further information 
about the trace line” (p. 2). This has certain 
implications to system design where the op- 
erator or display mechanism must time-share. 
The results of this study, would indicate that 
only a minimal amount of exposure of the 
target under control is necessary for accurate 
motion-prediction of constant rate targets. 

The failure of the tracking-monitoring 
comparison to produce differences or transfer 
effects indicates that it makes little difference 
whether S receives his target information in- 
put actively or passively. Figure 2 indicates a 
trend toward a marked transfer effect from 
tracking to monitoring, which might have im- 
plications for training for a task where track- 
ing is not possible. However, this effect failed 
to achieve statistical significance. 

One brief remark on the performance meas- 
ure employed in this study is advisable. The 
raw absolute error data were transformed to 
relative error, as it appeared to be more 
meaningful to express error in terms of the 
speed (and therefore distance traveled in the 
prediction interval). If the performance meas- 
ure had been absolute error uncorrected for 
target speed, the opposite relationship of 
error to speed would have resulted as shown 
in Figure 5. This would imply that in ap- 
plication of these results to radar-like dis- 
plays, the future position of high-speed targets 
would be most inaccurately predicted. 


WIENER 
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VIGILANCE PERFORMANCE AS A FUNCTION OF 
INTERPOLATED REST ' 


BRUCE O. BERGUM anp DONALD J. LEHR 


United States Army Air Defense Human Research Unit, Fort Bliss, Texas 


2 experiments were performed on the effects of interpolated rest upon monitor- 
ing performance at both high and low signal rates. Experiment I employed 2 
groups of 20 Ss each; Experiment II employed 2 groups of 10 Ss each. One 
group of Ss worked on a light monitoring task for 3 30-min. periods separated 
by 10-min. rest periods. The 2nd group worked continuously for 90 min. on 
the same task. Experiment I employed 24 signals/hr; Experiment II employed 
6 signals/hr. The results indicated a highly significant facilitation of detection 
performance as a result of interpolated rest at both signal rates and demon- 
strate the effectiveness of relatively brief rest intervals in maintaining high per- 


formance even with low signal rates. 


The introduction of rest periods has con- 
sistently yielded improved vigilance detection 
performance over performance under nonrest 
conditions. Solandt and Partridge (1946), 
Saldanha (1956), and Jenkins (1958) have 
all reported various degrees of facilitation em- 
ploying various lengths and frequencies of 
rest intervals. Probably the most dramatic 
effects were those reported by Mackworth 
(1950), who found that when he alternated 
half-hour watches with half-hour rest pe- 
riods, uniform detection performance oc- 
curred, and in fact, performance after the 
rest period was even slightly improved over 
that for the first half-hour. 

Of those studies reported, however, all have 
employed a relatively high signal presentation 
rate and none has been concerned with the 
extent to which the effects of interpolated 
rest can be generalized to tasks in which a 
relatively low signal rate is employed. The 
purpose of the present studies was to deter- 
mine the extent to which such generalizations 
are valid. 


EXPERIMENT [| 


This experiment tested the effects of inter- 
polated rest on performance of a task employ- 
ing a relatively high rate of signal presenta- 


1The research reported in this study was per- 
formed for the Human Resources Research Office of 
the George Washington University under contract to 


the Department of the Army. The opinions expressed 
in this report are solely those of the authors and do 
not necessarily reflect those of the sponsoring agency. 
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tion. The primary purpose of this study was 
to serve as a reference standard for Experi- 
ment IT. 


Method 


Subjects. A total of 40 National Guard trainees 
from the Army Training Center, Fort Bliss, served 
as the subjects in this experiment. 

Apparatus. Four isolation booths were employed 
in this study. Each booth was equipped with a cir- 
cular panel, 13 inches in diameter, consisting of 20 
4-inch red lamps which illuminated in sequence at 
a rate of 12 rpm. A signal consisted of the failure of 
a lamp to illuminate in its normal sequence. The dis- 
plays were mounted vertically at seated eye height 
on the rear walls of the booths and a small table was 
located directly beneath the display and adjacent to 
the wall. Room illumination was by a shaded 40- 
watt frosted lamp mounted above and behind the 
subject. 

A preset program consisting of 24 signals per hour 
(Mackworth, 1950) caused a signal to be generated 
on the display and responses were made by de- 
pressing a hand-held pushbutton. Both signals and 
responses were automatically recorded on paper-tape 
recorders located in a central control area external 
to the booths. The control area and four booths were 
connected by a two-way intercommunication net- 
work. 

Conditions. All subjects worked in isolation through 
three periods of approximately 30 minutes each, for 
a total of 90 minutes of monitoring. The 40 subjects 
were randomly assigned to two groups of 20 subjects 
each. The subjects in the first group worked con- 
tinuously through the 90-minute period, while sub- 
jects in the second group were permitted a 10-minute 
rest period outside the test booths between the first 
and second, and second and third, monitoring pe- 
riods. The response measure was percentage of cor 
rect detections. 
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Results 


The mean percentage of correct detections 
for both groups for each of the three time pe- 
riods are presented in Table 1. The rest con- 
dition shows an almost constant high level of 
performance (approximately 93% correct de- 
tections overall), while the massed condition 
shows a marked and continuing performance 
decrement with progressive work periods. 

A Kruskal-Wallis one-way analysis of vari- 
ance for these data yielded an H of 5.44, p 
< .01. For this rate of signal presentation, 
rest periods yielded significantly superior de- 
tection performance. 


EXPERIMENT II 


This experiment tested the effect of rest in- 
tervals on detection performance in a task 
employing a relatively low signal presenta- 
tion rate. 


Method 


Subjects. A total of 20 National Guard trainees 
from the Army Training Center, Fort Bliss, served 
as the subjects in this experiment. 

Apparatus. The apparatus for this experiment was 
identical to that employed in Experiment I. 

Conditions. The conditions for this experiment 
were identical to those employed in Experiment I 
with the exceptions that only 10 subjects served in 
each group and the signal rate was 6 signals per 
hour rather than the 24 signals per hour employed 
in Experiment I 


Results 


The mean percentage of correct detections 
for both groups for each of the three test 
periods are presented in Table 2. The results 
are similar to those obtained in Experiment I. 
The rest condition shows an almost constant 
high level of performance over the full testing 


TABLE 1 


PERCENTAGE OF CORRECT DETECTIONS FOR REST AND 
Contrnvous Groups At HicH SIGNAL RATE 


Time Period 


Condition 2 A verage 


Rest 
Continuous 


rage 
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rABLE 2 


PERCENTAGE OF CoRRECT DETECTIONS FOR REST AND 
Continuous Groups AT Low SIGNAL RATE 


Time Period 


Condition Average 


Rest 
Continuous 


Average 


period, while the massed condition shows a 
marked performance decrement with progres- 
sive work periods. 

A Kruskal-Wallis one-way analysis of vari- 
ance for these data yielded an H of 4.73, 
p < .025. As was the case in Experiment I, 
rest periods resulted in superior detection 
performance. 


DISCUSSION 


The introduction of rest intervals results in 
significantly superior detection performance 
over the entire monitoring period employed 
in these studies. In addition, the effect of this 
variable appears to be equally effective even 
when the signal presentation rate is reduced 
by a factor of four. This finding is of interest 
in view of the fact that several writers (Deese 
& Ormand, 1953; Jenkins, 1958; Kappauf & 
Powe, 1959; Nicely & Miller, 1957) have 
reported significantly poorer detection per- 
formance with lower signal rates. On this 
point, it is of special interest to note that the 
continuous group in Experiment I tended to 
perform at a slightly lower level than the 
continuous group in Experiment II, although 
the signal rate was higher for the former 
group. Comparison of these groups in terms 
of a Mann-Whitney U test, however, indicated 
no statistically significant difference between 
the groups. These results are very similar 
to those for the control groups in two ex- 
periments reported by Bergum and Lehr 
(1962). Signal rates of 6 and 24 per hour 
were employed in the latter study in con- 
junction with a paired-monitoring variable. 
The results showed almost identical control 
group performances at both rates. These re- 
sults, along with those reported by Wherry 
and Webb (1951), who found no differences 
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in performance on an auditory task employing 
signal rates of 12 and 30 per hour, suggest 
that this variable is less general in character 
than has ordinarily been thought. It seems 
worth noting that those studies which have 
reported significant effects for signal rate have 
employed rates differing by a factor of from 
4 to 60 between high and low rates, whereas 
in those studies in which no differences were 
demonstrated the rates differed by a factor 
no greater than four. It appears that the 
effects of this variable tend to break down 
at the lower signal rate ratios, suggesting a 
possible threshold effect for differential per- 
formance as a function of rate differences. 

In terms of the rest variable, the present 
results indicate that interpolated rest is among 
the most powerful variables reported to date 
in this area. It is worth noting that Experi- 
ment I yielded results very similar to those 
found by Mackworth (1950) employing the 
same signal schedule, but with only one-third 
the amount of rest and suggests strongly that 
the minimum facilitative length of rest period 
may be well under the 10 minutes employed 
in the present studies. 


WITH INTERPOLATED REST 
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THE IDENTIFICATION OF TRAITS RELATED TO 
MANAGERIAL SUCCESS 


JOHN A. HICKS 
Aerojet-General Corporation, Azusa, California 
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California State Polytechnic College 


To evaluate the effectiveness of a test battery in discriminating between suc- 
cessful and unsuccessful managers, a comprehensive battery was administered 
to 76 supervisors of an autonomous, medium-sized operating division. Results 
from- the Guilford-Zimmerman Aptitude Survey, California Test of Mental 
Maturity, and Structured-Objective (S-O) Rorschach Test were related to 
ratings of overall performance, promotability, and versatility by peers and 
superiors. The test battery showed significant correlations with peer ratings 
in all three of these areas (.46-.68), but showed a significant correlation (.44) 
only with the supervisors’ evaluation of versatility. The S-O Rorschach Test 
proved to be the most effective test in the battery. 


A great deal of effort has been invested in 
trying to identify the characteristics which 
make a successful manager. In attempting to 
do this, many test and personal history vari- 
ables have been explored, often with very 
little success. 

That much of the success of the manager 
is attributable to his personal characteristics 
and his ability to operate intuitively in a 
variety of situations has long seemed ob- 
vious to students of the area. Although many 
individuals have explained leadership and 
success in situational terms, there has been 
a continuing effort to identify characteristics 
or background factors which would account 
for this success. Rosen, Levinger, and Lip- 
pitt (1961) sketch six characteristics which 
seem to lend power to the individual in vari- 
ous situations. Kirkpatrick (1961) describes 
a series of personal history variables which 
have been used to effectively predict success 
in Chamber of Commerce executives. 

If, as Porter (1961) has suggested in a re- 
cent study, the same traits are important in 
lower level managers as are important to 
the success of middle management personnel, 
then it should be possible to identify these 
traits across a sample which covers several 
levels of these managers. This would permit 
us to use larger samples of personnel to iden 


tify certain basic traits as a stepping stone 


with 


1 Affiliated Charles A 


at time of this study 


McKeand Company 


to consideration of the difference between 
levels and specialties. 

This study was a pilot project which in- 
cluded almost all of the supervisors and 
managers in an independent operation. The 
purpose of the study was to determine if a 
broad battery of tests covering aptitudes, 
temperament, and creativity could be used 
to identify certain basic characteristics for 
selection, promotion, and training purposes. 

In a secondary sense, this study was de- 
signed to determine the economic feasibility 
of a testing program for this level of person- 
nel and to delimit the areas for further ex- 
ploration. A follow-up phase of this project 
which calls for a study of the relationships 
between personal history variables and the 
criteria of managerial success defined in this 
study is currently under way. 


METHOD 


Sample 


Seventy-six managers, 
and senior 


supervisors, shop foremen 
engineers (engineering supervisors) of 
a product division of a major manufacturer partici- 
pated in this study. This included all of the super- 
visors within the division with the exception of a 
few who could not be scheduled even after repeated 
efforts to do so 


Test Battery 


One of the major 
relationship 


areas of exploration was the 
temperament and managerial 


weaknesses of questionnair 


between 
success. To avoid the 
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and yet retain 
norms, the 


objective scoring and standardized 
Structured-Objective (S-O) Rorschach 
Test was used. This test is a multiple-choice modifi- 
cation of the Rorschach and provides measurement 
on 15 variables (Stone, 1958). The original vali- 
dation included a large industrial population and 
norms have been established covering 46 occupa- 
tional groupings (California Test Bureau, 1960). 

The mental ability portion of the battery con- 
sisted of the California Test of Mental Maturity 
and four sections of the Guilford-Zimmerman Apti- 
tude Survey: Verbal Comprehension (VC), General 
Reasoning (GR), Numerical, and Spatial Visualiza- 
tion (SV). Despite the lack of industrial data on 
the Aptitude Survey, it was used pro- 
vided a factored aptitude measure for superior 
adults (Guilford & Zimmerman, 1956) 

To measure the area of creativity the Executive 
test was used. The results from this test are not 
included in this report, however, since the scoring 
procedures and norms are still in the experimental 
stage. 


because it 


Criteria 


It was concluded early in the study that any 
measure of managerial performance would be heavily 
weighted by the opinions of those individuals with 
and for whom each manager 
cided, therefore, to obtain 


worked. It was de- 
peer ratings and 
visory ratings on three areas 


super- 
overall performance, 
promotability, and versatility. The test battery was 
then related to each of the six resulting scales 

To obtain the peer ratings the participants were 
grouped into 10 groups consisting of 3-13 individ- 
uals. The individuals in each of these groups had 
substantial personal knowledge of the work of the 
other individuals, were at a comparable level, and 
had comparable professional backgrounds. 

In order to provide some stability to the super- 
visors’ ratings, two individuals in a superior capacity 
were asked to rate each participant. For this 
reason, not all of the raters had direct supervisory 
experience with the subordinate they rated, but all 
of the raters were in a position to review much 
information about the ratee’s work 

The rating form was designed so 
viduals rated on each trait before the 
proceeded to the next trait. The raters were in- 
structed to make as much discrimination between 
the individuals as they could, keeping in mind the 
full range of alternatives available. When the ratings 
were received and compiled, each of the peer rating 
groups was compared to the other groups in terms 
of the mean and range of ratings given. These 
were similar enough so that no correction was con- 


indi- 
rater 


that all 
were 


idered necessary. The reliability of the peer ratings 
that for 5 


wa 6 while upervisors wa 


Proce dure 


After the and procedure of the program 
explained to the participating supervisors, 
they were given the rating forms for their peers and 


purpose 
were 
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subordinates to be completed at the rater’s con- 
venience. As soon as all of the complete ratings had 
been received, the individuals were tested in three 
groups. 

When the results had been tabulated and profiles 
made, each individual received a summary of his 
results. The testing results and their implications 
were discussed broadly in a group session. This was 
followed by private interviews for those who wished 
to discuss their results in detail 

To minimize the threat which these managers 
would feel from the testing program they were as- 
sured that (a) the results of the peer and super- 
visory ratings would be used only for purposes of 
validating the test battery and that complete data 
would not be made available to management; and 
(b) no data, either from the tests or the ratings, 
which would be detrimental to the individuals’ 
careers would be released to management. In this 
regard they were told that division management 
would know who the outstanding individuals were 
on the ratings and on the test battery and that 
division management would receive statistical data 
showing the overall relationships 


Analytic Method 


To facilitate the analysis of the data, each of the 
six sets of ratings were broken into the top 27%, 
middle 46%, and bottom 27%. A preliminary analy- 
sis was made to determine which test variables 
showed the greatest discrimination between the top 
and bottom groups on the six sets of ratings. Cor- 
relation coefficients were then calculated for these 
variables and a multiple correlation computed using 
them. Finally, by using the Taylor-Russell tables 
and estimates of turnover cost it was possible to 
prepare charts which showed the break-even points 
for the testing program under various conditions 
and the amount of saving which might be expected 


RESULTS 


Table 1 shows the intercorrelations be- 
tween the major dimensions of the criteria. 
Two basic conclusions may be drawn from 
this table: (a) there is a substantial amount 
of common variance between the three areas 
of job success, the smallest correlation being 
.70 between promotability and_ versatility; 


rABLE 1 


INTERCORRELATIONS BETWEEN CRITERIA 


Overall perfor 
Promotability 
Versatility 
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rABLE 2 


CORRELATIONS BETWEEN SELECTED TEST VARIABLES 


S-O Rorschach Test 


Criterion 


Overall performance 

Peer 

Supervisor 
Promotability 

Peer 

Supervisor 
Versatility 

Peer 


Supervisor 


*p < .05. 
* > < 01. 


(6) although the ratings of peers and super- 
visors are significantly correlated the rela- 
tionship is not a large one, ranging from .51 
to .59. The peers and supervisors were ob- 
viously using somewhat different standards 
in evaluating these individuals. 

The correlations between the criteria and 
selected test variables are listed in Table 2. 
The last column contains the multiple correla- 
tion coefficients for each of the criteria. 

The four S-O Rorschach Test subscores 
which showed the greatest relationship across 
the criteria are W, Dd, M, and H. These are 
defined by the S-O Rorschach Test manual 
as: Theoretical (W), Pedantic (Dd), Ac- 
tivity Potential (MM), and Human Relation- 
ships (H). The Aptitude Survey variables 
showed only a small relationship to the 
criteria. 

Certain of the test variables showed a 
pattern of relationship among the criteria. 
H was significantly correlated with all three 
of the peer scales. W was significant for both 
of the promotability scales and Dd for the 
versatility scales. 

The test battery proved much more ef- 
fective in predicting the peer ratings than it 
did in predicting the supervisors’ ratings, as 
may be seen from a comparison of the mul- 
tiple Rs. On overall performance the test 
battery correlated .68 for the peer’s ratings 
as contrasted with .30 for the supervisors’ 
ratings, a difference significant at the 1% 
level. On promotability the difference (.55 
.34) was significant at the 5°) level, and on 
versatility there was no significant difference. 


AND CRITERIA 


Aptitude Survey 


VC GR SV 


Since there is no significant difference in the 
reliability of the two sets of ratings, these 
data suggest that each group sees significant 
dimensions of performance which the other 
does not. 

To estimate shrinkage which would occur 
in applying these results to a new sample, 
Wherry’s shrinkage formula was used. The 
corrected coefficients range from .35 to .63 
for the three peer rating scales, all significant 
above the 5% level. For the supervisor’s rat- 
ing of versatility, the corrected correlation 
was .30, also significant at the 5% level. 

Another facet of this problem was the 
relationship between the reliability of the 
criteria and the correlation coefficients. Us- 
ing the formula for the correction for atten- 
uation, the expected correlation was esti- 
mated using the assumption that the obtained 
coefficient was the true correlation. Under 
this assumption the same four coefficients 
ranged from .27 to .43. All of these except 
the coefficient for the peer rating of versatil- 
ity (.29) were significant at the 5% level. 

The conclusions about the validity of the 
test battery were not changed, then, using 
either an estimate of shrinkage or correction 
for attenuation to be expected from the cri- 
teria and test reliabilities. To answer the 
question of shrinkage conclusively, however, 
a cross-validation would be necessary. 


DISCUSSION 


It appears, from this study, that mana- 


gerial success can be predicted to a significant 
degree using current 


testing instruments. 
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Managers in this study represent a wide range 
of skills and background and have in com- 
mon only the fact that they are operating as 
managers in a technical organization. 

This leads to the second conclusion that, 
in this organization at least, there are cer- 
tain basic characteristics which the success- 
ful managers possess regardless of their 
areas of specialization. We would expect 
that there are measureable differences be- 
tween managers in widely divergent fields 
such as engineering, production, and admin- 
istration; however, until one has established 
the things which they have in common these 
other questions appear secondary. 

Another interesting result of this study 
was that peer evaluations of overall per- 
formance and promotability appeared to be 
more effective in prediction than evaluations 
made by the superiors, with differences sig- 
nificant at the 1% and 5% levels, respec- 
tively. This raises questions about the total 
evaluation process in an organization. One 
reasonable hypothesis might be that the man’s 
associates know him much better than his 
superiors do, since a man is always trying to 
impress his superiors. Some of the incidental 
data which were collected in this study indi- 
cated that this was the case for many of 
these individuals. 

On the other hand, it is equally reasonable 
to assume that the supervisor has a more 
realistic view of the man in terms of the 
managerial requirements of the organization. 
The fact that none of the test variables pre- 
dicted well the supervisors’ ratings, however, 
suggests that the results may have simply 
been a matter of inaccuracy in the ratings of 
the supervisors. 

This result posed another problem. In ap- 
plying test results it was necessary to know 
which.-types of job success to predict, i.e., 
success in the eyes of his peers or his super- 
visor. The decision was made that in the early 
stages of the application of this data the 
supervisor hiring the man would simply be 
given a statement of the probabilities that 
this man would be highly regarded by him 
and by the man’s peers, permitting the super- 
visor to assign the relative weights. 

Mental aptitudes did not show a large re- 
lationship to managerial success in this study, 
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a fact which has been pointed out in many 
earlier studies. This has been interpreted as 
the result of sample attenuation through pre- 
selection on education and career achievement. 

It is interesting to compare this result 
with Porter’s (1961) study in which both 
bottom and middle managers ranked the 
description, “intelligent,” as one of the most 
important traits for managerial success. 
Either managers are describing other traits as 
intelligence or they simply believe that people 
like themselves must be intelligent. 

The success of the S-O Rorschach Test in 
identifying certain temperament character- 
istics which related to managerial success 
suggests that it may be an instrument which 
would be particularly applicable to industrial 
settings. As a multiple-choice test which can- 
not be faked, it avoids many of the problems 
which questionnaires have. 

To the extent that the constructs are valid 
and they follow basic Rorschach theory, we 
can describe the successful manager in this 
organization as an individual who shows a 
great deal of emotional strength; who does 
not structure or organize his activities to the 
extent that the less successful managers do; 
and who tends to view things from a broad, 
theoretical point of view, avoiding overin- 
volvement in detail. Much work needs to- be 
done to define the responsibilities of the 
manager before we can be sure what these 
interpretations mean in such an_ industrial 
setting. 

The finding on emotional strength seems 
to bear out an earlier conclusion in a study of 
union business agents (Rosen & Rosen, 
1957). Using the MMPI, they found that 
one of the scales which seemed to discrimi- 
nate between successful and _ unsuccessful 
agents was the Ego Strength scale. It would 
seem in terms of. face validity that much of 
the same factor is being measured in these 
two tests. Emotional resilience and the ability 
to generate and sustain directed activity are 
indicated in both scales. 

Another problem for future research is the 
discrepancy between peer and supervisory 
ratings. Should this prove to be a common 
phenomenon, a study of its causes and the 
relative validity of the two viewpoints would 
do much toward clarifying what true job 
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effectiveness is and what types of cues are 
used to measure it. 
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